Big Data Engineer at WebSenor InfoTech | Torre

Big Data Engineer

Emma highlights
This highlight was written by Emma’s AI. Ask Emma to edit it.
Full-time

Legal agreement: Employment

Provide your expected compensation while applying
location_on
Remote (anywhere)
Shared by
Paulina Romero Moreno
2 days ago

Responsibilities


We are looking for an experienced Big Data Engineer to join our team.Job DetailsExperience: 7–8 YearsEmployment Type: Full-TimeWork Mode: RemotePrimary SkillsScalaPySparkAWS GlueBig Data Pipeline DevelopmentData Validation & ProfilingSecondary SkillsREST APIsAsync JavaScriptSQL / NoSQLPostgreSQLMongoDBElasticsearchWeb DesignTesting with Scala / JavaKey ResponsibilitiesDevelop and maintain scalable Big Data pipelines.Build data processing solutions using Scala and PySpark.Develop ETL/ELT pipelines using AWS Glue.Perform data validation, profiling, and quality checks.Work with SQL and NoSQL databases.Develop and integrate REST APIs.Perform data transformation and optimization.Troubleshoot data pipeline and processing issues.Write and maintain automated tests using Scala/Java.Collaborate with engineering, QA, and business teams.What We’re Looking For7–8 years of relevant experience in Big Data / Data Engineering.Strong hands-on experience with Scala and PySpark.Solid experience with AWS Glue.Strong understanding of data pipelines and data quality.Good knowledge of SQL/NoSQL databases.Strong analytical and problem-solving skills.Excellent communication and collaboration skills.Interested candidates can share their updated CV at career@websenor.com