Senior Big Data Engineer
Qualys · Pune · posted 16 Oct 2026
Full-timeIT & Software5+ years
About the job
Come work at a place where innovation and teamwork come together to support the most exciting missions in the world!
Senior Big Data Engineer
Job Description: We are seeking a Senior Big Data Engineer to design, build, and operate core components of the data platform and pipeline architecture behind Qualys' Enterprise TruRisk Platform, processing billions of daily transactions.
Responsibilities:
• Design, build, and maintain high-throughput data platform and pipeline components using Spark and Kafka.
• Debug, tune, and optimize Spark jobs and Kafka pipelines to manage growing data volumes.
• Collaborate with product, professional services, and sales engineering teams on architecture design and technical trade-offs.
• Establish and refine technical standards, system documentation, and best practices across the engineering team.
• Mentor junior and mid-level engineers on complex technical issues and pipeline performance.
Required Qualifications:
• Minimum 5 years of experience in data engineering or big data platform development.
• Bachelor's degree in Computer Science, Computer Engineering, or a related technical field.
• Demonstrated experience designing, building, and optimizing distributed pipelines using Apache Spark and Apache Kafka.
• Hands-on experience scaling data platform infrastructure to process high-volume/high-throughput transaction workloads.
Preferred Qualifications:
• Experience working with high-volume, multi-tenant enterprise platform environments.
• Proficiency in Scala, Java, or Python for data processing applications.
• Proven experience mentoring junior or mid-level engineering team members.
Similar jobs
AI Developer
Nemetschek India · Bangalore, Karnataka · 16 Nov 2026
Staff Software Engineer
Commonwealth Bank of Australia · India · 15 Nov 2026
Data Scientist - AI Developer
HP · India · 15 Nov 2026
Staff Engineer
Nextpower · India · 15 Nov 2026
J
Data QA Engineer
Jobgether · India · 15 Nov 2026
Senior Machine Learning Engineer II
SurveyMonkey · Bangalore, Karnataka · 15 Nov 2026
Collected from Qualys's official careers site by LitCareer. Always apply on the employer's own site; LitCareer never charges you to apply.