Data Engineer Pyspark
Citi · DLF CYBERCITY 12B · posted 6 Nov 2026
Full-timeIT & Software
About the job
The Applications Development Intermediate Programmer Analyst is an intermediate level position responsible for participation in the establishment and implementation of new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to contribute to applications systems analysis and programming activities.
This is a hands-on development role responsible for building, testing, optimizing, and supporting batch and real-time data-processing solutions using technologies such as Apache Spark, Databricks, Kafka, Scala, Python, and SQL. The successful candidate will work within a data-engineering team to deliver reliable and maintainable data pipelines, troubleshoot performance and production issues, and follow established architecture, coding, testing, security, governance, and operational standards under the guidance of senior developers and technical leads.Responsibilities:
• Develop, test, enhance, and support batch and real-time data pipelines using Apache Spark, Databricks, Kafka, Scala, Python, and SQL.
• Write clean, reusable code and participate in code reviews, unit testing, integration testing, data validation, and deployment activities.
• Analyze Spark execution plans, DAGs, metrics, and logs to troubleshoot failures and improve processing performance.
• Build and maintain Iceberg or Delta Lake solutions using established Lakehouse and medallion architecture patterns.
• Collaborate with technical leads, developers, analysts, and support teams to deliver assigned work and resolve production issues while following established controls and standards.
• Utilize knowledge of applications development procedures and concepts, and basic knowledge of other technical areas to identify and define necessary system enhancements, including using script tools and analyzing/interpreting code
• Consult with users, clients, and other technology groups on issues, and recommend programming solutions, install, and…
Similar jobs
A
Specialist, Software Engineer – IBM ACE & ETL
AB3 Nationwide Life and Annuity Insurance · · 17 Nov 2026
A
Consultant, Software Engineer (DevXP)
AB3 Nationwide Life and Annuity Insurance · · 17 Nov 2026
A
Specialist, Software Engineer (Full Stack)
AB3 Nationwide Life and Annuity Insurance · · 17 Nov 2026
AWS Cloud Engineer
Nemetschek India · Bangalore, Karnataka · 17 Nov 2026
C
Entry Level Software Engineer - Atlanta, GA
CAI Cox Automotive Svcs · Atlanta GA · 17 Nov 2026
(USA) Senior, Machine Learning Engineer
Walmart · (USA) SUNNYVALE TECH CORNERS BLDG 6 CA SUNNYVALE Home Office · 16 Nov 2026
Collected from Citi's official careers site by LitCareer. Always apply on the employer's own site; LitCareer never charges you to apply.