We offer best in class solutions for our Customers, offerings leveraging the latest Technology. Our organization operates in an environment of fairness, honesty and transparency to our Customers and Employees. As we seek to understand your company-specific problems we are able to provide tailor-made and cost-effective solutions.

ADPMN Inc

We, ADPMN Provide World Best Consulting Services For Our Clients, Contact Us and See The results Instantly!!

Role: Senior Data Engineer (Python / Apache Spark / AWS)

100 % Remote

Duration: Long term

We are seeking aSenior Data Engineerwith strong hands-on experience inPythonandApache Sparkto design, develop, and optimize scalable data pipelines and distributed data processing solutions. The ideal candidate will have expertise in ETL/ELT development, data modeling, cloud technologies, and software engineering best practices. This is a hands-on role requiring the ability to build production-grade data solutions in an Agile environment.

Required Skills

10+ yearsof Data Engineering or Software Engineering experience.Strong hands-on Python experience (Required).Strong hands-on Apache Spark / PySpark experience (Required).Experience building scalableETL/ELT pipelines.Strong knowledge ofdata modeling, SQL, distributed computing, and data warehousing.Experience withpipeline orchestration(Airflow, Databricks Workflows, or similar).Experience developing and consumingREST APIs.Strong understanding ofsoftware engineering principles, including object-oriented programming, design patterns, data structures, and algorithms.Experience withGit, CI/CD pipelines, automated testing, and Agile/Scrum.Excellent analytical, troubleshooting, and communication skills.AWS experience (S3, EC2, Glue, Lambda, EMR).Databricks experience and/or Apache Spark certification.Experience withDocker, Kubernetes, Delta Lake, Snowflake.Experience withR or SASis a plus.

Key Responsibilities

Design, develop, and optimize enterprise data pipelines usingPythonandApache Spark.Build scalable ETL/ELT solutions for large datasets.Design and maintain data models supporting analytics and reporting.Optimize Spark jobs for performance, scalability, and reliability.SubmitDevelop APIs and data services supporting enterprise applications.Implement automated testing, CI/CD, and data quality controls.Collaborate with architects, software engineers, data scientists, and business stakeholders to deliver high-quality data solutions.Participate in code reviews, technical design discussions, and production support.