VPP-11 - Senior Data Engineer

VPP-11 – Senior Data Engineer

We are seeking a talented Senior Data Engineer to join our team. In this role you’ll design, develop and maintain massively scaling cloud-based data solutions—building a modern data lake architecture, enabling machine learning workflows, and driving data-driven decision making across both commercial and operational functions.

Department:
Engineering
Project Location(s):
United States - Remote
Job Type:
Full time - Contract
Education:
Bachelor's

Key Responsibilities

Cloud Platform & DevOps

Partner with development teams to deploy and maintain projects on AWS and Microsoft Azure.

Architect, develop, deploy and operate services at scale using Java and Apache Spark.

Implement infrastructure-as-code (CloudFormation/Terraform) and configuration management (Ansible).

Data Pipeline & Framework Development

Build and maintain PySpark frameworks for orchestration, monitoring and scalable data pipelines.

Integrate pipelines with message streaming systems (Kafka, Kinesis).

Production Support & Incident Management

Own Pre-Prod and Prod environments: application deployments, pipeline monitoring, disaster recovery, and incident/problem resolution.

Data Acquisition, Transformation & Analytics

Partner with cross-functional teams to define and execute data ingestion, transformation and enrichment for operational and analytical use cases.

Leverage Power BI, DAX and SQL to deliver dashboards and reports that drive sustainable revenue and growth.

Automation & Innovation

Develop and implement automation solutions to accelerate data workflows and improve reliability.

Agile Delivery & Mentorship

Apply Agile methodologies (Scrum/Kanban) to manage deliverables.

Mentor and train junior engineers, fostering a dynamic and inclusive culture.

Qualifications

Required Technical Skills

Languages & Frameworks: Java, Python, Scala; PySpark, Apache Spark

Big Data & Streaming: EMR, Spark Streaming, Kafka, Kinesis

Cloud & Infrastructure: AWS (EC2, S3, EBS, ELB, RDS, IAM, Route 53, CloudFront, ElastiCache, WAF), Azure

IaC & Config Mgmt: CloudFormation or Terraform; Ansible

Databases & Warehouses: Redshift, MS SQL Server, Oracle

BI & Analytics: Power BI Desktop & Service, DAX, SQL

Containers & Orchestration: Docker, ECS/EKS or Kubernetes

Version Control: Git

Operating Systems: Linux and/or Windows

Soft Skills

Problem-solving: Create efficient, scalable, maintainable data solutions

Collaboration: Work effectively with engineers, data scientists, product and operations teams

Communication: Clear verbal and written skills for both technical and non-technical stakeholders

Adaptability: Thrive on cutting-edge technologies and AI-driven solutions

Apply now
Contact Us Now