Andres Marafioti
About
Detail
Multimodal Research Lead @ Hugging Face | 10+ YOE in AI R&D
Bern, Canton of Bern, Switzerland
Résumé
Jobs
verified_user
0% verified
Multimodal Research LeadHugging FaceApr 2025 - Current (1 year 7 months)Leading Hugging Face's multimodal research efforts, with projects including:
- SmolVLM - an efficient vision-language model for on-device inference (https://huggingface.co/blog/smolvlm2)
- SmolDocling - document understanding at scale (in collaboration with IBM Research) (https://huggingface.co/ds4sd/SmolDocling-256M-preview collaboration with IBM research)
- NanoVLM - a lightweight, open-source VLM training framework (- Multimodal Research LeadHugging FaceApr 2025 - Current (1 year 7 months)Leading Hugging Face's multimodal research efforts, with projects including:
- SmolVLM - an efficient vision-language model for on-device inference (https://huggingface.co/blog/smolvlm2)
- SmolDocling - document understanding at scale (in collaboration with IBM Research) (https://huggingface.co/ds4sd/SmolDocling-256M-preview collaboration with IBM research)
- NanoVLM - a lightweight, open-source VLM training framework ( - Machine Learning Research EngineerHugging FaceJun 2024 - Apr 2025 (11 months)
- Machine Learning Research EngineerHugging FaceJun 2024 - Apr 2025 (11 months)
- Senior Machine Learning EngineerUNITYJan 2022 - May 2024 (2 years 5 months)🎮 Senior MLE | Building safer gaming communities through Unity's Safe Voice product. 🌐
🚀 Playing a key role in developing and implementing ML solutions to combat in-game toxicity and enhance multiplayer experiences.
🔬 Joined the project during its early prototype phase and played a pivotal role in shaping its growth through strategic planning and coding.
🌟 Proudly contributed to the journey of reaching open beta status, promoting safer and more enjoyable gaming environments. - Senior Machine Learning EngineerUNITYJan 2022 - May 2024 (2 years 5 months)🎮 Senior MLE | Building safer gaming communities through Unity's Safe Voice product. 🌐
🚀 Playing a key role in developing and implementing ML solutions to combat in-game toxicity and enhance multiplayer experiences.
🔬 Joined the project during its early prototype phase and played a pivotal role in shaping its growth through strategic planning and coding.
🌟 Proudly contributed to the journey of reaching open beta status, promoting safer and more enjoyable gaming environments. - Machine Learning Engineer (research contract)IntuitiveAug 2021 - Nov 2021 (4 months)Worked on a short-term applied research project focused on the DaVinci surgical robot.
Developed a multi-sensor vision system and a dataset of ex-vivo surgical videos. Calibrated stereo cameras for 3D reconstruction and projected third-sensor data into 3D space.
Implemented and evaluated two ML algorithms intended for integration into the DaVinci system. This work was part of a research leave from my postdoctoral role at ARTORG. - Machine Learning Engineer (research contract)IntuitiveAug 2021 - Nov 2021 (4 months)Worked on a short-term applied research project focused on the DaVinci surgical robot.
Developed a multi-sensor vision system and a dataset of ex-vivo surgical videos. Calibrated stereo cameras for 3D reconstruction and projected third-sensor data into 3D space.
Implemented and evaluated two ML algorithms intended for integration into the DaVinci system. This work was part of a research leave from my postdoctoral role at ARTORG. - Postdoctoral ResearcherARTORG Center for Biomedical Engineering ResearchDec 2020 - Nov 2021 (1 year)Research on computer vision algorithms for surgical scene perception published on MICCAI.
Mentored three students from ETH, UniBE, and UNTREF.
Supervisor: Prof. Raphael Sznitman - Postdoctoral ResearcherARTORG Center for Biomedical Engineering ResearchDec 2020 - Nov 2021 (1 year)Research on computer vision algorithms for surgical scene perception published on MICCAI.
Mentored three students from ETH, UniBE, and UNTREF.
Supervisor: Prof. Raphael Sznitman - Doctoral ResearcherAustrian Academy of SciencesSep 2017 - Nov 2020 (3 years 3 months)Developed machine learning algorithms for audio generation. Published on industry-leading conferences such as ICML and Q1 journals such as IEEE's TSP, JSTSP, and TASLP.
Organized the coding challenge for the Austrian Academy of Sciences' AI summer school.
Member of the Machine learning, and the Mathematics and signal processing group.
Thesis Advisor: Dr. Robert Höldrich
Co-advisor: Dr. Piotr Majdak
Project Leader: Dr. Nicki Holighaus - Doctoral ResearcherAustrian Academy of SciencesSep 2017 - Nov 2020 (3 years 3 months)Developed machine learning algorithms for audio generation. Published on industry-leading conferences such as ICML and Q1 journals such as IEEE's TSP, JSTSP, and TASLP.
Organized the coding challenge for the Austrian Academy of Sciences' AI summer school.
Member of the Machine learning, and the Mathematics and signal processing group.
Thesis Advisor: Dr. Robert Höldrich
Co-advisor: Dr. Piotr Majdak
Project Leader: Dr. Nicki Holighaus - Software EngineerFarolatino Media NetworkSep 2015 - Aug 2017 (2 years)During my tenure as a Software Engineer within a six-member Agile team, I significantly contributed to the development of a consumer application. My key responsibilities included:
Architecting and developing critical components, enhancing both functionality and user engagement for a consumer-facing application.
Leading the GUI design and implementation using PySide (Qt) within an MVP framework, which resulted in a markedly improved user experience.
Developing and maintaining robust backend modules, mainly in Python, and managing tasks such as database operations (SQL) and network connectivity (C++ and Python's TCP sockets).
Overseeing database schema design and optimization, ensuring high standards of data integrit - Software EngineerFarolatino Media NetworkSep 2015 - Aug 2017 (2 years)During my tenure as a Software Engineer within a six-member Agile team, I significantly contributed to the development of a consumer application. My key responsibilities included:
Architecting and developing critical components, enhancing both functionality and user engagement for a consumer-facing application.
Leading the GUI design and implementation using PySide (Qt) within an MVP framework, which resulted in a markedly improved user experience.
Developing and maintaining robust backend modules, mainly in Python, and managing tasks such as database operations (SQL) and network connectivity (C++ and Python's TCP sockets).
Overseeing database schema design and optimization, ensuring high standards of data integrit - Teaching Fellow - Digital Signal ProcessingUniversidad Nacional de Tres de FebreroJul 2014 - Jul 2017 (3 years 1 month)In this dynamic role, I led the development and delivery of comprehensive lectures and coding assignments, focusing primarily on Python, Matlab, and integral software tools such as Matplotlib, Scikit-learn, and NumPy. My responsibilities included creating engaging course materials that not only introduced students to the fundamentals of digital signal processing but also provided hands-on experience with these industry-standard tools. I was deeply involved in grading assignments, offering personalized feedback, and guiding students through complex concepts and practical applications.
My promotion to Teaching Fellow in July 2016, after serving as a Teaching Assistant for two years, was a recognition of my growing expertise and inc - Teaching Fellow - Digital Signal ProcessingUniversidad Nacional de Tres de FebreroJul 2014 - Jul 2017 (3 years 1 month)In this dynamic role, I led the development and delivery of comprehensive lectures and coding assignments, focusing primarily on Python, Matlab, and integral software tools such as Matplotlib, Scikit-learn, and NumPy. My responsibilities included creating engaging course materials that not only introduced students to the fundamentals of digital signal processing but also provided hands-on experience with these industry-standard tools. I was deeply involved in grading assignments, offering personalized feedback, and guiding students through complex concepts and practical applications.
My promotion to Teaching Fellow in July 2016, after serving as a Teaching Assistant for two years, was a recognition of my growing expertise and inc - Teaching Assistant - Laboratory of ElectronicsUniversidad Nacional de Tres de FebreroJul 2012 - Jul 2013 (1 year 1 month)I worked preparing the laboratories for lectures. This included calibrating the necessary equipment. I also taught students how to use oscilloscopes, signal generators, distorsimeters and LCR meters and supervised the development of printed circuit board.
- Teaching Assistant - Laboratory of ElectronicsUniversidad Nacional de Tres de FebreroJul 2012 - Jul 2013 (1 year 1 month)I worked preparing the laboratories for lectures. This included calibrating the necessary equipment. I also taught students how to use oscilloscopes, signal generators, distorsimeters and LCR meters and supervised the development of printed circuit board.
Education
verified_user
0% verified
- UDoctor of Philosophy - PhD, Electrical and Electronics EngineeringUniversität für Musik und darstellende Kunst GrazOct 2017 - Feb 2021 (3 years 5 months)Graduated with distinction
Thesis: Exemplar-based audio inpainting in musical signals - UDoctor of Philosophy - PhD, Electrical and Electronics EngineeringUniversität für Musik und darstellende Kunst GrazOct 2017 - Feb 2021 (3 years 5 months)Graduated with distinction
Thesis: Exemplar-based audio inpainting in musical signals - Ingénieur en acoustique et vibrations, Mechanical EngineeringENSIM Ecole dingénieurs Le Mans UniversitéJan 2014Semester abroad.
- Ingénieur en acoustique et vibrations, Mechanical EngineeringENSIM Ecole dingénieurs Le Mans UniversitéJan 2014Semester abroad.
- Sound Engineer, AcousticsUniversidad Nacional de Tres de FebreroJan 2009 - Jan 2016 (7 years 1 month)Thesis: "Automatic identification of acoustical musical instruments".
Exchange semester at the école nationale supérieure d'ingénieurs du Mans (France, 2014).
Sound processing track with emphasis in digital signal processing and electronics. - Sound Engineer, AcousticsUniversidad Nacional de Tres de FebreroJan 2009 - Jan 2016 (7 years 1 month)Thesis: "Automatic identification of acoustical musical instruments".
Exchange semester at the école nationale supérieure d'ingénieurs du Mans (France, 2014).
Sound processing track with emphasis in digital signal processing and electronics.
Projects (professional or personal)
verified_user
0% verified
- MModelling and measuring in-the-ear earphones’ passive attenuationJan 2014 - Current (12 years 10 months)Purpose of the project is to model the passive attenuation of an earphone piece that will be provided by the company Parrot. The attenuation shall be estimated in two points: at the feedback microphone (used for active noise cancellation) placed right in front the driver, and at the eardrum point.
- MModelling and measuring in-the-ear earphones’ passive attenuationJan 2014 - Current (12 years 10 months)Purpose of the project is to model the passive attenuation of an earphone piece that will be provided by the company Parrot. The attenuation shall be estimated in two points: at the feedback microphone (used for active noise cancellation) placed right in front the driver, and at the eardrum point.
- DDiseño y construcción de un monitor Bi-amplificado de 2 vías con tweeter de cintaDec 2013 - Current (12 years 11 months)En el presente trabajo se expone el procedimiento para la construcción de un Monitor Bi-amplificado de 2 vías con un Tweeter de Cinta (RibbonTweeter), como continuación del trabajo realizado en la materia Electroacústica I [4]. Para el desarrollo del mismo, se consideró en primer lugar los cálculos pertinentes a los parámetros Thiel, obtenidos por el módulo DATS (Dayton Audio Test System) y procesados por el software que la empresa facilita. Junto a los resultados obtenidos y fijando un criterio de diseño de calidad, se procedió a cargar los datos en el software WinISD 0.44 en su versión gratuita, el cual nos otorga los parámetros necesarios para la construcción de la caja acústica, que contendrá todo el sistema electroacústico (fuente, a
- DDiseño y construcción de un monitor Bi-amplificado de 2 vías con tweeter de cintaDec 2013 - Current (12 years 11 months)En el presente trabajo se expone el procedimiento para la construcción de un Monitor Bi-amplificado de 2 vías con un Tweeter de Cinta (RibbonTweeter), como continuación del trabajo realizado en la materia Electroacústica I [4]. Para el desarrollo del mismo, se consideró en primer lugar los cálculos pertinentes a los parámetros Thiel, obtenidos por el módulo DATS (Dayton Audio Test System) y procesados por el software que la empresa facilita. Junto a los resultados obtenidos y fijando un criterio de diseño de calidad, se procedió a cargar los datos en el software WinISD 0.44 en su versión gratuita, el cual nos otorga los parámetros necesarios para la construcción de la caja acústica, que contendrá todo el sistema electroacústico (fuente, a
- DDiseño y construccion de Tweeter de cinta.Jul 2013 - Current (13 years 4 months)In this paper we explored the details of building a ribbon tweeter. In order to do so, the relevant calculations for the construction of the transducer were done using a software for simulation of the intrinsic magnetic parameters first. Then, we constructed the mechanical and electrical structure of the tweeter and the impedance adapter system (a toroidal transformer). Finally, the electric and acoustic parameters of the prototype were measured for subsequent calibration and error correction.
- DDiseño y construcción de un tweeter de cintaJul 2013 - Current (13 years 4 months)En el presente trabajo se expone el procedimiento para la construcción de un Tweeter de Cinta (RibbonTweeter). Para el desarrollo del mismo, se consideró en primer lugar los cálculos pertinentes a la construcción del transductor con el apoyo de una simulación por software de los parámetros magnéticos intrínsecos. En segundo lugar, se procedió a la construcción de la estructura mecánica y eléctrica del tweeter así como el sistema adaptador de impedancia (transformador toroidal). Por último, se midieron parámetros eléctricos y acústicos propios del prototipo para su posterior calibración y corrección de errores. Una vez realizado el diseño y construcción del dispositivo, se realiza un informe técnico que vincula el procedimiento de diseño, cá
- DDiseño y construcción de un tweeter de cintaJul 2013 - Current (13 years 4 months)En el presente trabajo se expone el procedimiento para la construcción de un Tweeter de Cinta (RibbonTweeter). Para el desarrollo del mismo, se consideró en primer lugar los cálculos pertinentes a la construcción del transductor con el apoyo de una simulación por software de los parámetros magnéticos intrínsecos. En segundo lugar, se procedió a la construcción de la estructura mecánica y eléctrica del tweeter así como el sistema adaptador de impedancia (transformador toroidal). Por último, se midieron parámetros eléctricos y acústicos propios del prototipo para su posterior calibración y corrección de errores. Una vez realizado el diseño y construcción del dispositivo, se realiza un informe técnico que vincula el procedimiento de diseño, cá
- DDiseño y construccion de Tweeter de cinta.Jul 2013 - Current (13 years 4 months)In this paper we explored the details of building a ribbon tweeter. In order to do so, the relevant calculations for the construction of the transducer were done using a software for simulation of the intrinsic magnetic parameters first. Then, we constructed the mechanical and electrical structure of the tweeter and the impedance adapter system (a toroidal transformer). Finally, the electric and acoustic parameters of the prototype were measured for subsequent calibration and error correction.
- IIntercomunicador Táctico para fuerzas especialesJul 2015 - Jul 2016 (1 year 1 month)Nos proponemos desarrollar un prototipo de intercomunicador táctico para situación de tomas de rehenes. Dicho sistema tiene el objetivo de sustituir el actual equipamiento utilizado por las fuerzas especiales en situaciones de negociación con captores. En la actualidad la comunicación entre negociador y captor se realiza con un sistema analógico y rudimentario, que limita el accionar de las fuerzas especiales, dado que posee limitaciones técnicas y funcionales. Es premisa de este proyecto resolver esta problemática y velar por la seguridad de los involucrados, prestando un sistema confiable, eficiente y de tecnología avanzada que permita una comunicación segura.
- IIntercomunicador Táctico para fuerzas especialesJul 2015 - Jul 2016 (1 year 1 month)Nos proponemos desarrollar un prototipo de intercomunicador táctico para situación de tomas de rehenes. Dicho sistema tiene el objetivo de sustituir el actual equipamiento utilizado por las fuerzas especiales en situaciones de negociación con captores. En la actualidad la comunicación entre negociador y captor se realiza con un sistema analógico y rudimentario, que limita el accionar de las fuerzas especiales, dado que posee limitaciones técnicas y funcionales. Es premisa de este proyecto resolver esta problemática y velar por la seguridad de los involucrados, prestando un sistema confiable, eficiente y de tecnología avanzada que permita una comunicación segura.