JOSE RIBAMAR FERREIRA JUNIOR Big Data Enginner

Scientific Researcher

Pinecone

Mar 2024 - May 2024 (3 months)

Annoy (Approximate Nearest Neighbors Oh Yeah)
HNSW (Hierarchical Navigable Small World)
TF-IDF (Term Frequency-Inverse Document Frequency)
BM25

G

AI Engineer (LLMs)

GooGolPlex

Mar 2024 - Current (2 years 8 months)

✔ Framework:( LangChain , LlamaIndex, Haystack, Hugging , PyTorch Lightning, Fairseq, OpenAI Codex, Pathways, LaMDA, Bard )
✔ Programming: Strong skills in languages such as Python, especially in NLP and ML libraries like TensorFlow, PyTorch, NLTK, etc.
✔ Knowledge of ML and NLP Algorithms: Deep understanding of machine learning algorithms and natural language processing.

✔ Mathematics and Statistics: Solid fundamentals in statistics, linear algebra, and calculus.
✔ Analytical Skills: Ability to analyze complex data sets and interpret the results of models.
✔ Data Management: Experience in handling and analyzing large volumes of data.
✔ Problem Solving and Critical Thinking: Ability to solve complex probl

I

AI Engineer (LLMs)

IPGMediabrands

Sep 2023 - Mar 2024 (7 months)

C

Data Architect (Cybersecurity Architect)

Chubut IT

Dec 2022 - Aug 2023 (9 months)

Developing and maintaining security architecture processes to address business and technology threats.
Contributing to the development of security strategy plans and road maps.
Creating and managing security architecture models, standards, and procedures.
Defining baseline security configuration standards for systems, networks, infrastructure, and applications.
Collaborating with global teams to enhance security measures and mitigate risks in IT infrastructure.
Evaluating security technologies and tools, and providing recommendations based on security metrics.
Conducting security assessments of vendors and ensuring compliance with security requirements.
Offering guidance and support to colleagues on best p

Senior Big Data Engineer / AI Engineer

DEUNA

Dec 2022 - Feb 2023 (3 months)

✔ORCHESTRATION
✔TRANSFORMATION
✔DATA INTEGRATION E ETL
✔BI E EMBEDDED ANALYTICS
✔CUSTO DATA APP
✔REVERSE ETL
✔OBSERVABILITY

Senior Big Data Engineer

DEUNA

Jun 2022 - Feb 2023 (9 months)

✔ Work with large, complex data sets to build data driven analytical products
Perform various technical aspects of software development including design, developing prototypes,
and coding
✔ SQL and Python, Scala, or Java
✔ Data solutions development in AWS
✔ Apache Spark, Flink, FireBolt, Metabase
✔ Apache Airflow or MWAA
✔ Apache Kafka, MSK, or Kinesis
✔ Amazon Redshift or Snowflake
✔ Adhere to security standards and coding best practices
✔ Continuously seek performance improvements and cost savings
✔ Deployment, support, and monitoring of software across development, integration, and production
environments
✔ Design and implement product features in colla

G

IA Engineer

GooGolPlex

May 2022 - Sep 2022 (5 months)

✔Project: Data Lake
✔Scala , Python
✔Neo4J 4.0

Big Data Engineer
- Solid knowledge in Hadoop platform, preferably in the Cloudera distribution;
- NoSQL, SQL DB, Oracle and MongoDB experience;
- Experience in SQL and Spark (Scala and Python);
- Knowledge in Hadoop, HDFS, Map Reduce, Pig, Hive and HBase, Apache Spark or Apache Storm,
Apache Solr or Elastic;
- Knowledge of data ingestion in the Hadoop environment, such as Apache Nifi, Apache tools
Sqoop, Apache Flume and Apache Kafka (Desirable knowledge of confluent solutions);
- Practical knowledge in ETL processes from different data sources (collect, validate, homogenize,
transform and model);
- Analytical skills, logi

Senior Big Data Engineer / AI Engineer

Grupo Abraxas

Aug 2021 - Dec 2022 (1 year 5 months)

Handling tools, platforms and ETL scripts mainly in Python, Java and/or Scala
Distributed technologies such as Hadoop, Spark and MapReduce.
Parquet, Avro, ORC file formats.
Azure Data Factory: creation and automation of pipelines, IR (Integration Runtime),
Schedules, triggers. Blob storage, Data Lake Storage Gen2.

Activities to be Performed

✔Project: Des-Cloud
✔Scala , Python
✔Azure: Databricks, Data Factory, Data Flow , Synapses Analytics
✔Modeling and development of MDWs.
✔Architecture and process of loads for Data Lakes.
✔Writing and tuning SQL queries.
✔Extraction, storage and processing of data.
✔Data Integration via APIs
✔Pipeline orchestration.

Technical Lead Data Engineer / AI Engineer at SEFIRA

Grupo Abraxas

Aug 2021 - Mar 2022 (8 months)

Managing ETL tools, platforms and scripts mainly in Python, Java and/or Scala, distributed technologies such as Hadoop, Spark and MapReduce. Parquet, Avro, ORC file formats. Azure Data Factory: creation and automation of pipelines, IR (Integration Runtime), schedules, triggers. Blob storage, Data Lake Storage Gen2.

✔Project: Data Lake / Des-oCloud
✔Python
✔Oracle
✔SQL
✔SQLServer
✔Snowflake

✔Project: Data Lake / Brasil
✔Scala , Python
✔Oracle
✔Azure
✔Azure Cloud Services
✔Development of Complex Data Ingestion & Transformation Pipelines
✔Spark Programming (Scala, Python, PySpark, SparkSQL)
✔Spark Streaming
✔Azure Event Hubs
✔Azure Data Lake Storage<

I

Big Data Analyst

IPsense

Feb 2021 - Apr 2021 (3 months)

Big Data Analyst

Project Kubernetes AWS:
https://github.com/GCPBigData/ipsense-EKS
https://github.com/GCPBigData/troubleshooting-k8s-apps

Project Metrics | Cloud Monitoring | Google Cloud:
https://github.com/GCPBigData/Cloud-Monitoring

Project Metrics | Cloud Monitoring | AWS:

B

Big Data Engineer

Jan 2021 - Dec 2021 (1 year)

- Handling tools, platforms and ETL scripts mainly in Python,
Java and/or Scala.Distributed technologies such as Hadoop, Spark and MapReduce. Parquet, Avro, ORC file formats. Azure Data Factory: creation and automation of pipelines, IR

G

Big Data Developer

GooGolPlex

Jul 2020

✔Project: Apache Parquet
✔Scala , Python , Julia

G

Data Scientist

GooGolPlex

Jul 2020 - Jan 2021 (7 months)

✔Project: SisVida
✔Scala , Python, Java

G

Big Data Developer

GooGolPlex

May 2020 - Jul 2020 (3 months)

Full-time
LocationSantiago, Santiago Metropolitan, Chile
✔Project: Feigenbaum δ = 4.66
✔Parallel programs on JVM and Scala.

G

Data Scientist

GooGolPlex

Mar 2020 - May 2020 (3 months)

✔Project: φ = 1,61
✔Trend, Cycle, Seasonality, Random
✔Neural Networks, TensorFlow, Keras.
✔ Forecast

G

Data Scientist

GooGolPlex

Jan 2020 - Mar 2020 (3 months)

Project: Edwin Smith
Bayesian Predictive System for Detection of Breast Cancer.
Pneumonia Symptoms and Diagnosis

✔Neural Networks, TensorFlow, Keras, PyTorch.
✔Oculus VR, Unity.

I

Big Data Engineer

IPsense

Jan 2020 - Dec 2021 (2 years)

- Programming - Python. Platform : AWS. Migration from on premise to AWS. Review the current Python ETL framework for data pipelines and propose new initiatives to improve overall reliability and robustness. Development of new ETLs, using Python.

G

Google Cloud Big Data Engineer

GooGolPlex

Dec 2019 - Jan 2020 (2 months)

✔ Project: Edsger Dijkstra

✔ Graph Analytics for Big Data
✔ Neural Networks and Deep Learning
✔ TensorFlow for Artificial Intelligence, Machine Learning, and Deep Learning

✔ Big Data HDFS, MapReduce and Spark RDD
✔ Big Data Analysis: Hive, Spark SQL, DataFrames and GraphFrames
✔ Big Data Applications: Machine Learning at Scale
✔ Big Data Applications: Real-Time Streaming
✔ Big Data Modeling and Management Systems
✔ Big Data with Machine Learning

G

Google Cloud Big Data Engineer

GooGolPlex

Jun 2019 - Jan 2020 (8 months)

Project: Ramanujan

✔ Focuses on the transfer of data to GCP ( Cloud VPC ).
Derive business insights from extremely large datasets using Google BigQuery
Train/evaluate and predict using machine learning models using TensorFlow and Cloud ML
Leverage unstructured data using Spark and ML APIs on Cloud Dataproc
✔ Design and build data processing systems on Google Cloud Platform
Process batch and streaming data by implementing autoscaling data pipelines on Cloud Dataflow
✔ Migrating local infrastructure from Hadoop to Google Cloud Platform provides an overview of the migration process, with the focus on moving large and persistent clusters to an ephemeral model.
Migrate data from HBase to Cloud Bigtab

G

Big Data Engineer

GooGolPlex

Oct 2018 - Mar 2020 (1 year 6 months)

✔ Manage the timely flow of information to users. Collaborate and interact with different functional users, in the design of BI / Bigdata solutions. Identify, plan and extract information from different sources in a timely manner.

✔ Development of Integrations (via API, ETL, others) to data sources in various formats.

● Develop BI / Big Data solutions, focused on the implementation of Landing / Raw data ingests towards the BI / BigData platforms, along with the development of data consumption and exploitation areas

● Creation of data structures for DataScientist and Business Analyst work

● Development of prototypes (Mockup) of Dashboard Analytics

✔ Perform ETL maintenance of data ext

Senior Software Development Engineer

Veolia Colombia

Aug 2018 - Nov 2018 (4 months)

Senior Software Development Engineer

AMcom

Jul 2018 - Dec 2018 (6 months)

G

Machine Learning Engineer

GooGolPlex

Mar 2018 - Oct 2018 (8 months)

Main Responsibilities
Design of algorithms for multi-sensor fusion with the goal of vehicle-surrounding object tracking and prediction Contribute to production-quality implementation of above algorithms into C++/Python/Java.

+ Design and implement data and control flow needed to integrate new LIDAR
+ Develop, deploy, and optimize custom hardware drivers
+ Develop novel calibration processes involving multiple sensors and actuation stages in the loop
+ Analyze data collected from sensor systems, and develop tools to help do so
+ Support sensor manufacturing by customizing existing systems to improve test integration, assembly tracking, and reporting pipelines
+ Design core blocks for FPGAs

Z

Senior Software Development Engineer

Zaal Information Technology

Feb 2018 - Dec 2018 (11 months)

G

Machine Learning Engineer

GooGolPlex

Jan 2018 - Mar 2018 (3 months)

Developing solutions:
✔ MQTT, Internet of Things connectivity protocol. It is an extremely lightweight publish-subscribe communication model, useful for connections in remote locations where a small code footprint is the order of the day.

B

Senior Software Development Engineer

BFM TV

Jun 2017 - Jan 2018 (8 months)

G

Machine Learning Engineer

GooGolPlex

Jan 2017 - Mar 2018 (1 year 3 months)

Machine Learning Engineer : GooGolPlex
Development of Machine Learning : Navigation Mesh / Python / TensorFlow
C # , WebGL , Unity , Cloud Firestore , Realtime Database , Neo4J.

G

Big Data Engineer

GooGolPlex

Jan 2017 - Jan 2021 (4 years 1 month)

- Dataproc makes open source data and analytics processing ( Apache Spark, BigQuery) Spring Batch provides reusable functions that are essential in processing large volumes of records

C

Senior Software Development Enginee

Ceará State Health Secretariat

Jan 2013 - Dec 2017 (5 years)

Public Federal Server

INSS

May 2008 - Jan 2015 (6 years 9 months)

The main formal sources of Brazilian social security law are:

Federal Constitution of 1988 (arts. 193 a 204);
Organic Law on Social Security (Lei nº 8.212/91);
Organic Law of Social Security Benefits (Lei nº 8.213/91);
Complementary law (Lei n. 108/2001);
Complementary law (Lei n. 109/2001);
Decree - Social Security Regulation (Lei n. 3048/99).
Low No. 8,112, of December 11, 1990

Public Federal Server

INSS

Jan 2008 - Jul 2021 (13 years 7 months)

JOSE RIBAMAR FERREIRA JUNIOR

About

Detail

Timeline

Résumé

JOSE RIBAMAR FERREIRA JUNIOR

About

Detail

Behavioral traits