U
Cleared Data Engineer
US101 Guidehouse · US - VA, Arlington · posted 13 Nov 2026
Full-timeIT & Software
About the job
Job Family:
Data Engineering & Architecture ConsultingTravel Required:
Up to 50%Clearance Required:
Active Secret
What You Will Do:
• Design, develop, test, deploy, and maintain scalable batch and streaming data pipelines in Databricks using Python, PySpark, SQL, and reusable engineering patterns.
• Transform raw source data into curated, analysis-ready datasets and dimensional models that support cybersecurity metrics, risk analysis, dashboards, and executive reporting.
• Develop automated data-quality controls for ETL jobs, including schema, completeness, validity, consistency, uniqueness, timeliness, referential-integrity, and source-to-target reconciliation checks.
• Define appropriate handling for failed quality checks, including quarantining invalid records, stopping critical loads, generating alerts, documenting exceptions, and coordinating corrective action with data owners.
• Schedule and orchestrate production workflows; monitor job status, freshness, throughput, latency, resource utilization, and failures; troubleshoot root causes; and restore processing within agreed service levels.
• Optimize pipeline reliability, performance, and cost through efficient transformations, workload configuration, incremental processing, partitioning, and compute-resource management.
• Implement and maintain data-governance and quality-assurance standards, including access controls, metadata, data classification, ownership, lineage, retention, auditability, and protection of sensitive cybersecurity information.
• Maintain source-to-target mappings, data dictionaries, transformation rules, validation evidence, standard operating procedures, runbooks, and other technical documentation needed for operations, knowledge transfer, and audit readiness.
• Partner with cybersecurity analysts, data owners, system administrators, dashboard developers, and business stakeholders to define data requirements, metrics, thresholds, and acceptance criteria.
• Maintain effective working…
Similar jobs
B
Experienced Software Application QA/Tester - Java Full Stack
Boeing Distribution · IND - Bangalore, India · 15 Nov 2026
B
Experienced Software Application Developer – Java Full Stack
Boeing Distribution · IND - Bangalore, India · 15 Nov 2026
B
Lead Software Application DevOps Engineer
Boeing Distribution · IND - Bangalore, India · 15 Nov 2026
B
Lead Software Application Engineer - Java Full Stack
Boeing Distribution · IND - Bangalore, India · 15 Nov 2026
B
Senior Lead Software Architect
Boeing Distribution · IND - Bangalore, India · 15 Nov 2026
B
Senior Lead Product Owner
Boeing Distribution · IND - Bangalore, India · 15 Nov 2026
Collected from US101 Guidehouse's official careers site by LitCareer. Always apply on the employer's own site; LitCareer never charges you to apply.