Noureldien Hussein

Available for Computer Vision Research - Interned @ Microsoft, Qualcomm
Email: noureldien [at] live.com
Scholar  LinkedIn  GitHub  GoodReads  Blog  Resume  C.V.


Available for Research Positions in Computer Vision
Experience

2020 – Graduate Research Assistant – University of AmsterdamAmsterdam, NL
2020 – Research Intern – Microsoft – Redmond, US
2019 – Research Intern – Qualcomm – Amsterdam, NL

Education

2020 – PhD Computer Vision – University of Amsterdam
2015 – MSc Artificial Intelligence – University of Southampton
2012 – BSc Computer and System Engineering – Ain Shams University

Research Interests

Experience


Graduate Research Assistant – University of Amsterdam – 01.2016 - Present – Amsterdam, NL

• Conduct world-class research published in top conferences and journals
• Co-supervise MSc/BSc thesis projects, and assist in teaching BSc subjects
• Reviewer for conferences and journals: CVPR, ICCV, ECCV, TPAMI, IEEE-ToM, ACM-MM
• Helped in organizing academic conferences: ECCV16, ACM-MM16, ICCV HVU

Research Intern, Computer Vision – Microsoft – 02.2020 - 05.2020 – Redmond, US

• Conduct research on understanding facial expressions in video streams
• Expected outcomes: scientific publication and tangible product prototype

Research Intern, Computer Vision – Qualcomm – 06.2019 - 10.2019 – Amsterdam, NL

• Conducted research on efficient recognition of minutes-long human activities in videos
• Research outcome is concluded and submitted to ECCV 2020

Education


PhD Computer Vision – University of Amsterdam – 01.2016 - 12.2020 – Amsterdam, NL

• Research: action recognition, temporal modeling, video description, visual storytelling
• Advisors: Arnold Smeulders, Efstratios Gavves

MSc Artifical Intelligence – University of Southampton – 10.2014 - 10.2015 – Southampton, UK

• Computer Vision • Machine Learning • Intelligent Agents • Computational Finance
• Thesis: End-to-end Hierarchical CNN for Large-Scale Traffic Sign Detection and Recognition

BSc Computer and System Engineering – Ain Shams University – 07.2005 - 06.2012 – Cairo, EG

• Software Engineering • Neural Networks • Operating Systems • Computer Networks
• Data Structures and Algorithms • Computer Security • Computer Architecture
• Thesis: Arabic Sign Language Recognition in Real Time (Distinction, Award-winning)

Research


PIC: Permutation Invariant Convolution for Recognizing Long-range Activities
arXiv, 2020
Noureldien Hussein, Efstratios Gavves, Arnold W. M. Smeulders

a novel convolutional block named Permutation Invariant Convolution (PIC) is proposed. It is permissible in many ways that a long-range activity can take place over time. The result is improvements in the accuracy of recognizing the long-range activities of Breakfast, Charades, and MultiThumos.


@inproceedings{hussein2020pic,
title     = {PIC: Permutation Invariant Convolution for Recognizing Long-range Activities},
author    = {Hussein, Noureldien and Gavves, Efstratios and Smeulders, Arnold W.M.},
booktitle = {arXiv},
year      = {2020}
}

TimeGate: Conditional Gating of Segments in Long-range Activities
arXiv, 2020
Noureldien Hussein, Mihir Jain, Babak Ehteshami Bejnordi

A conditional gating mechanism is proposed to select the most relevant segments from a video of long-range activity. The selection is conditioned on both the segment and its context, i.e. the video itself. The result is extreme efficiency in classifying long-range activities without compromising the performance.


@inproceedings{hussein2020timegate,
title     = {TimeGate: Conditional Gating of Segments in Long-range Activities},
author    = {Hussein, Noureldien and Jain, Mihir and Bejnordi, Babak Ehteshami},
booktitle = {arXiv},
year      = {2020}
}

Self-Selective Context for Interaction Recognition
ICPR, 2020
Mert Kilickaya, Noureldien Hussein, Efstratios Gavves, Arnold Smeulders

For recognizing human-object interaction from single image, we propose new sources of contexts. In addition, we propose a conditional gating model for fusing the context features. The result is a substantial improvement on three benchmarks: HICO, V-COCO and CINT.


@inproceedings{kilickaya2020self,
title     = {Self-Selective Context for Interaction Recognition},
author    = {Kilickaya, Mert; Hussein, Noureldien; Gavves, Efstratios; Smeulders, Arnold W.M.},
booktitle = {ICPR},
year      = {2020}
}

VideoGraph: Recognizing Minutes-Long Human Activities in Videos
ICCV Workshop, 2019
Noureldien Hussein, Efstratios Gavves, Arnold W. M. Smeulders

A method to represent a long-range action as a graph. A soft version of the graph is reconstructed, where both the graph nodes and graph edges are learned entirely from data. The result is recognizing minutes-long human activities in videos.


@inproceedings{hussein2019videograph,
title     = {VideoGraph: Recognizing Minutes-Long Human Activities in Videos},
author    = {Hussein, Noureldien and Gavves, Efstratios and Smeulders, Arnold W.M.},
booktitle = {ICCV Workshop on Scene Graph Representation and Learning},
year      = {2019}
}

Timeception for Complex Action Recognition
CVPR, 2019 – Oral Presentation
Noureldien Hussein, Efstratios Gavves, Arnold W. M. Smeulders

A novel temporal layer for 3D CNNs with multi-scale temporal convolutions and much reduced computation. The result is a CNN for modeling minute-long complex actions, 8 times longer than best related method.


@inproceedings{hussein2018timeception,
title     = {Timeception for Complex Action Recognition},
author    = {Hussein, Noureldien and Gavves, Efstratios and Smeulders, Arnold W.M.},
booktitle = {CVPR},
year      = {2019}
}

Unified Embedding and Metric Learning for Zero-Exemplar Event Detection
CVPR, 2017
Noureldien Hussein, Efstratios Gavves, Arnold W. M. Smeulders

A manifold is learned using contrastive loss, in which there is a joint embedding of videos of human events and their related articles. The result is end-to-end model with best results on TRECVID MED dataset.


@inproceedings{hussein2017unified,
title     = {Unified Embedding and Metric Learning for Zero-Exemplar Event Detection},
author    = {Hussein, Noureldien and Gavves, Efstratios and Smeulders, Arnold W.M.},
booktitle = {Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition},
year      = {2017}
}

University of Amsterdam and Renmin University at TRECVID 2016: Searching Video, Detecting Events and Describing Video
TRECVID Workshop, 2016
Cees G. M. Snoek, Jianfeng Dong, Xirong Li, Xiaoxu Wang, Qijie Wei, Weiyu Lan, Efstratios Gavves, Noureldien Hussein, Dennis C. Koelma, Arnold W. M. Smeulders

Summary for our method used in the annual competition for zero-shot event recognition TRECVID MED 2016.


@inproceedings{snoek2016trecvid,
author    = {Snoek, Cees G. M. and Dong, Jianfeng and Li, Xirong and Wei, Qijie and Wang, Xiaoxu and Lan, Weiyu and Gavves, Efstratios and Hussein, Noureldien and Koelma, Dennis C. and Smeulders, Arnold W.M.},
title     = {University of Amsterdam and Renmin University at TRECVID 2016: Searching Video, Detecting Events and Describing Video},
booktitle = {TRECVID Workshop},
year      = {2016},
url       = {https://ivi.fnwi.uva.nl/isis/publications/2016/SnoekPTRECVID2016},
}

Teaching & Supervision


Thesis Supervision

Temporal Localization of Actions in Untrimmed Videos

Juan Buhagiar, Noureldien Hussein, Efstratios Gavves
MSc Artifical Intelligence, 2019


Improving Word Embeddings for Zero-Shot Event Localisation by Combining Relational Knowledge with Distributional Semantics

Joop L. Pascha, Efstratios Gavves, Noureldien Hussein
MSc Artifical Intelligence, 2018


Real-Time Composing of Restaurant Label Classifiers Utilizing Semantic Word Similarity

Tony Nguyen, Noureldien Hussein, Efstratios Gavves
BSc Artifical Intelligence, 2017


Teaching Assistance

Autonomous Mobile Robots

BSc Artificial Intelligence, 2018

Information Visualization

BSc Computer Science, 2017

Autonomous Mobile Robots

BSc Artificial Intelligence, 2016

Talks


Trends in Recognizing Complex Human Activities in Videos

03.2020 – Invited by Prof. Dr. Mubarak Shah, University of Central Florida (Online, Covid-19)

Permutation Invariant Convolution for Recognizing Long-range Activities

01.2020 – Qualcomm AI Research

VideoEpitoma: Efficient Recognition of Long-range Actions

10.2019 – Qualcomm AI Research

Recent Advances in Understanding Long-range and Complex Actions

10.2019 – Guest Lecturer, University of Amsterdam

VideoGraph: Recognizing Minutes-long Human Activities

05.2019 – Qualcomm AI Research

Trends in Action Recognition

03.2019 – Guest Lecturer, University of Amsterdam

Timeception: Going Deeper with Temporal Convolutions

10.2018 – Qualcomm AI Research

Decoupled Spatio-Temporal Convolutions for Recognizing Actions in Long Videos

03.2018 – Qualcomm AI Research

Unified Embedding and Metric Learning for Zero-exemplar Event Detection

02.2017 – Qualcomm AI Research

The Story of This: Object-Instance Driven Video Description

04.2016 – Qualcomm AI Research

The Road to Start-up Your Idea

12.2012 – Social Innovation Summit, US

Winning the First Place in Microsoft Imagine Cup

10.2012 – Microsoft Middle East Annual Meeting, Turkey

Miscellaneous


Patents

Recognizing Minutes-Long Human Activities in Videos
US Patent App. 16/827,342

Noureldien Hussein, Efstratios Gavves, Arnold W. M. Smeulders


Unified Embedding with Metric Learning for Zero-Exemplar Event Detection
US20180137360A1

Noureldien Hussein, Efstratios Gavves, Arnold W. M. Smeulders


Peer Reviewing

Conferences

CVPR, ICCV, ECCV, NeurIPS, ICLR, ACM-MM

Journals

TPAMI, IEEE-ToM


Awards

3rd Place – Kaggle In-class Competition, Recommender Systems, 2015 – Online
3rd Place – Microsoft Imagine Cup Grant, 2012 – Seattle, US
1st Place – Microsoft Imagine Cup, Windows Phone 2012 – Sydney, AU
1st Place – Microsoft Imagine Cup, Egypt Local Finals, Software Design, 2010 – Warsaw, PL

Contact


Email: noureldien [at] live.com
Office: +31-(0)20-525-8627
Address:

Quva Lab, Room C3.250a
Informatics Institute, University of Amsterdam
Science Park 904, 1098 XH Amsterdam, The Netherlands