We offer a position as an

Early Stage Researcher (M/F/D)

in the Marie Skłodowska-Curie Innovative Training Network Project MenelaosNT in the field

Design of an AIC CMOS vision system for spatio-temporal event detection.

Machine learning and, in particular deep learning techniques constitute a unique framework for analog to information (AIC) compression. Nevertheless, the feasibility of a hardware implementation of such power and memory-hungry algorithms calls for new strategies that benefit from the low power features of analog and mixed-signal design techniques. The final goal of this work will be the design of a low Size, Weight and Power (SWaP) AIC CMOS vision system for spatio-temporal event detection through deep learning tracking techniques. The system will comprise a CMOS vision chip with focal-plane processing and a general-purpose embedded hardware such as an FPGA. The CMOS vision chip will acquire the video and provide the detections that trigger the tracking. The baseline of our tracking approach will be state-of-the-art neural networks that learn similarity functions. Compressive deep learning techniques like binary weighting, weight sharing and pruning will be required to fit such networks on the FPGA.

The successful candidate will be employed for a maximum period of three years full-time equivalent and receives a generous financial package plus an additional mobility and family allowance according to the rules for Early Stage Researchers (ESRs) in an EU Marie Sklodowska-Curie Actions Innovative Training Networks (ITN). A career development plan will be prepared for each fellow in accordance with his/her supervisor and will include training, planned secondments and outreach activities in partner institutions of the network. The ESR fellows are supposed to complete their PhD thesis by the end of the 3rd year of their employment. For more information please visit the Marie Sklodowska-Curie Actions Innovative Training Networks website.

assignment Your Tasks

  • Definition of tasks of interest for ex- and in-situ explorations by the consortium
  • Evaluation of different algorithms for spatial localization of foreground events by the CMOS vision sensor chip through different software frameworks like OpenCV or Caffe
  • Design of the CMOS vision sensor chip
  • Hardware-oriented state-of-the-art siamese neural network for tracking through deep learning compression techniques like binary weighting, pruning, etc.
    • FPGA implementation of a hardware-oriented siamese neural network
    • On-board evaluation of the final AIC CMOS vision system for spatio-temporal event detection

        account_box Profile

        • Master of Science in Electrical Engineering, Electronics Technology, Electrical Engineering Technology, Electrical and Computer Engineering, Physics, Industrial Engineering, Information Technologies or related fields
        • ESRs must demonstrate that their ability to understand and express themselves in both written and spoken English is sufficiently high for them to derive the full benefit from the network training. Non-native English speakers are required to provide evidence of English language competency. (TOEFL … )

        work Planned Secondments

        • INSITU, Vigo, Spain, Prof. Dr. P. Arias Sanchez, 6 months, testing of the platforms

        With more than five centuries of tradition, the University of Santiago de Compostela is a historic institution that projects itself to the future and beyond its frontiers, always attentive to the different demands of society, where it stands as an important academic frame of reference and where it develops its academic and research work. Centuries of history give the University an special capacity to merge the experience, security and confidence with present and future challenges.
        In the last decades, the universities of Coruña and Vigo already segregated, the USc student population numbers over 45.000. Nowadays, the University is organized into two Campuses, Santiago and Lugo, which include 30 centres, nearly 80 departments and more than 60 degrees, apart from numerous installations such as research institutes, halls of residence, sports and cultural facilities, libraries, etc. Definitively, with the security and confidence of 500 years of experience, the University of Santiago de Compostela looks towards the future without forgetting its past, promoting new initiatives and putting its knowledge and leadership in the service of the demands of our society.

        The position will be located at

        University of Santiago de Compostela (USC)
        Praza do Obradoiro
        15782 Santiago de Compostela, Spain

        Supervisor: Prof. Dr. Paula López Martínez

        Planned Recruitment date: 1st September 2020.

        Eligibility Criteria and Mobility Rule

        ESRs must, at the date of recruitment, be in the first four years (full-time equivalent research experience) of their research careers and have not been awarded a doctoral degree. Full-Time Equivalent Research Experience is measured from the date when the researcher obtained the first degree entitling him/her to embark on a doctorate (either in the country in which the degree was obtained or in the country in which the researcher is recruited), even if a doctorate was never started or envisaged. Researchers can be of any nationality.

        ESRs must not have resided or carried out their main activity (work, studies, etc.) in the country of the recruiting beneficiary for more than 12 months in the 3 years immediately before the planned recruitment date. Compulsory national service, short stays such as holidays, and time spent as part of a procedure for obtaining refugee status under the Geneva Convention are not taken into account.

        Back to overview Online application