Data Engineer – PySpark Developer

Alpha Consultants

Emma

You'll optimize scalable Spark data pipelines, driving performance for diverse client solutions.

Emma highlights

This highlight was written by Emma’s AI. Ask Emma to edit it.

Full-time

Legal agreement: Employment

Hidden

(SIGN IN to learn if it’s a match)

Remote (anywhere)

Match

You have opted out of job matches in .

To undo this, go to the 'Skills and Interests' section of your preferences.

Review preferences

Shared by

about 1 month ago

ResponsibilitiesBuild & optimize scalable Spark data pipelinesMigrate legacy RDD-based code to DataFrame/Dataset APIsImprove Spark job performance & scalabilityWork on distributed data processing systemsKey Skills:PySparkApache SparkRDDsDataFramesSpark OptimizationPythonSQLDAGParquetORCAvroData EngineeringGood to Have:GCPDatabricksEMRAirflowSpark StreamingCI/CDGitWe are looking for a strong PySpark Developer with deep expertise in Core Apache Spark and performance optimization.📍 Location: Remote💼 Experience: 5–8 Years⚡ Relevant Experience: 4+ Years in PySparkInterested candidates can share their updated resume at hiring@alpha-consultants.inCompany: Alpha Consultants

Proficient

Apache Spark

Avro

Data engineering

PySpark

Python

SQL

No experience, but interested

Airflow

CI/CD

Databricks

Git

About Alpha Consultants:

We are the team of consultants that provide our clients with strategic and cost effective technology and business one stop solution designed for their specific business needs. Our solutions are designed to help achieve both the immediate and long-term goals of our clients. Our Services Includes: Accounting & Business Services: 1- Starting a Business 2- Accounts registration with CRA 3- Permits and Licenses 4- Business Income & Expenses (Book Keeping) 5- Planning your Business 6- Organizing Business Finances 7- Hiring & Training of Employees 8- Marketing 9- Customized Business Software’s 10- Reporting 11- Taxes (GST/HST) Educational Institution/ Career College: 1- Career College Setup 2- Administration 3- Admissions 4- Marketing 5- Instructor Training & Development 6- Program Development 7- Accounting and Record Keeping 8- Ministry Compliance 9- Audits 10- Internship contracts Information Technology: 1- Web Development 2- E-Commerce 3- Software Development 4- Social Media Marketing 5- Search Engine Optimization International Student Admissions: 1- Recruitment of International Students 2- Processing of applications 3- High School / College / University Admissions 4- Student Visa Applications 5- Pick up from airport 6- Short term Accommodation 7- Transport. Immigration Services: We provide full range of Immigration services to Canadian or International clients. 1- Visit Visa Applications 2- Student Visa 3- Work Permit 4- Federal Skilled Worker 5- Business Class 6- Family Class 7- PNP 8- Arranged Employment International Medical Graduates. 1- Career Plan 2- Immigration services 3- Registration with licensing organization 4- Preparation of Licensing exams 5- College admission 6- Certification courses 7- New comer settlement services. 8- Mentorships 9- Observers & Volunteers New Comer Settlement Services

Reputation:

Signalers: 1

www.alphaconsultants.ca/

learn more about Alpha Consultants

To edit the organization's information go to Alpha Consultants's team genome.

Admin access needed

Alpha Consultants has to validate your admin access to edit their information. You won’t be able to edit until it is approved.

Team members:

Need assistance?

CHAT WITH US

Job admins:

Need assistance?

CHAT WITH US

Optionally, you can add more information later (benefits, pre-screening questions, etc.)

Payment confirmed

A member of the Torre team will contact you shortly

In the meantime, continue adding information to your job opening.