Data EngineeringApache SparkData AnalyticsData PipelinesData QualityData ScienceData ValidationExtract Transform LoadNon-Functional RequirementsAzure Data FactoryPythonDatabricksData Lake ConceptsData Lake
Mid-level (3-4 years) -
New YorkUnited States
We believe in the power of technology to transform businesses and build a better world.
33630+ employees
B2B
Role
Who you are
Experienced in building scalable and reliable data pipelines using Databricks and Spark
Strong experience with ETL processes and data warehouse solutions
Positive communicative and accountability oriented
Able to provide training on best practices in architecture
Knowledge of Design Patterns Tools and Principles
What the job involves
Optimize data pipelines for performance scalability and reliability
Ensure data quality and integrity throughout the data lifecycle
Collaborate with data scientists analysts and other stakeholders to understand and meet their data needs
Troubleshoot and resolve data-related issues providing root cause analysis and recommendations
Document data pipeline specifications requirements and enhancements
Create new data validation methods and data analysis tools
Implement ETL processes and data warehouse solutions ensuring compliance with data governance and security policies
UST is a global digital transformation solutions provider empowering businesses with cutting-edge technology and deep domain expertise. For over two decades, UST has been at the forefront of innovation, helping organizations around the world create transformative solutions for a sustainable and impactful future.
Company benefits
10 days of paid vacation per year
6 days of paid sick leave per year (pro-rated for new hires)
10 paid holidays
Eligible for bereavement leave and jury duty
401(k) Retirement Plan with employer matching
Eligible for medical dental and vision insurance
Company-paid life insurance
Accidental death and disability insurance
Short- and long-term disability benefits
Voluntary short-term disability benefits available
Participate in Health Savings Account (HSA) and Flexible Spending Account (FSA)