Job Description

Job Summary:

Our client is seeking a Senior Data Engineer to join their team! This position is located in New York, New York or Bristol, Connecticut.

Duties:

• Design, build, and optimize large-scale data pipelines using Python, Spark, and Scala, maintaining strict uptime SLAs
• Architect and develop reusable shared libraries that abstract complex business logic to ensure consistency across data pipelines
• Maintain and enhance distributed data processing systems in production environments
• Partner cross-functionally with Product Managers, Architects, and Engineering teams to deliver reliable and scalable data solutions
• Develop and document standards for pipeline configuration, naming conventions, partitioning strategies, and governance best practices
• Ensure high operational excellence, data quality, and reliability across datasets consumed by Engineering, Analytics, Data Science, and Operations teams
• Identify performance bottlenecks and optimize for scale, cost efficiency, and reliability
• Participate actively in Agile/Scrum ceremonies and contribute to continuous team improvement
• Build strong relationships with internal stakeholders to understand evolving data needs and prioritize impactful enhancements
• Maintain detailed documentation to support data governance, lineage, and compliance requirements

Desired Skills/Experience:

• Bachelor’s degree in Computer Science, Engineering, or a related technical field
• 5+ years of experience building and maintaining large-scale data pipelines in production environments
• Strong Python programming expertise with solid software engineering fundamentals
• Hands-on experience with distributed processing frameworks such as Apache Spark
• Experience with workflow orchestration tools such as Apache Airflow
• Strong SQL skills with the ability to analyze and optimize complex datasets
• Experience working in cloud environments
• Strong problem-solving and algorithmic thinking skills
• Experience operating in production environments with uptime and reliability expectations
• Excellent analytical, documentation, and communication skills
• Self-starter with the ability to quickly learn new technologies and frameworks

Benefits:

• Medical, Dental, & Vision Insurance Plans
• Employee-Owned Profit Sharing (ESOP)
• 401K offered

The approximate pay range for this position is between $62.00 and $89.00 . Please note that the pay range provided is a good faith estimate. Final compensation may vary based on factors including but not limited to background, knowledge, skills, and location. We comply with local wage minimums.

At KellyMitchell, our culture is world class. We’re movers and shakers! We don’t mind a bit of friendly competition, and we reward hard work with unlimited potential for growth. This is an exciting opportunity to join a company known for innovative solutions and unsurpassed customer service. We're passionate about helping companies solve their biggest IT staffing & project solutions challenges. As an employee-owned, women-led organization serving Fortune 500 companies nationwide, we deliver expert service at a moment's notice.

By applying for this job, you agree to receive calls, AI-generated calls, text messages, or emails from KellyMitchell and its affiliates, and contracted partners. Frequency varies for text messages. Message and data rates may apply. Carriers are not liable for delayed or undelivered messages. You can reply STOP to cancel and HELP for help. You can access our privacy policy at

Job Tags

Similar Jobs