U

Cleared Data Engineer

US101 Guidehouse · US - VA, Arlington · posted 13 Nov 2026
Full-timeIT & Software

About the job

Job Family: Data Engineering & Architecture ConsultingTravel Required: Up to 50%Clearance Required: Active Secret What You Will Do: • Design, develop, test, deploy, and maintain scalable batch and streaming data pipelines in Databricks using Python, PySpark, SQL, and reusable engineering patterns. • Transform raw source data into curated, analysis-ready datasets and dimensional models that support cybersecurity metrics, risk analysis, dashboards, and executive reporting. • Develop automated data-quality controls for ETL jobs, including schema, completeness, validity, consistency, uniqueness, timeliness, referential-integrity, and source-to-target reconciliation checks. • Define appropriate handling for failed quality checks, including quarantining invalid records, stopping critical loads, generating alerts, documenting exceptions, and coordinating corrective action with data owners. • Schedule and orchestrate production workflows; monitor job status, freshness, throughput, latency, resource utilization, and failures; troubleshoot root causes; and restore processing within agreed service levels. • Optimize pipeline reliability, performance, and cost through efficient transformations, workload configuration, incremental processing, partitioning, and compute-resource management. • Implement and maintain data-governance and quality-assurance standards, including access controls, metadata, data classification, ownership, lineage, retention, auditability, and protection of sensitive cybersecurity information. • Maintain source-to-target mappings, data dictionaries, transformation rules, validation evidence, standard operating procedures, runbooks, and other technical documentation needed for operations, knowledge transfer, and audit readiness. • Partner with cybersecurity analysts, data owners, system administrators, dashboard developers, and business stakeholders to define data requirements, metrics, thresholds, and acceptance criteria. • Maintain effective working…

Read the full description on US101 Guidehouse's site ↗

Skills

Upload your CV on LitCareer to see which of these you match.

Similar jobs

B
Experienced Software Application QA/Tester - Java Full Stack
Boeing Distribution · IND - Bangalore, India · 15 Nov 2026
B
Experienced Software Application Developer – Java Full Stack
Boeing Distribution · IND - Bangalore, India · 15 Nov 2026
B
Lead Software Application DevOps Engineer
Boeing Distribution · IND - Bangalore, India · 15 Nov 2026
B
Lead Software Application Engineer - Java Full Stack
Boeing Distribution · IND - Bangalore, India · 15 Nov 2026
B
Senior Lead Software Architect
Boeing Distribution · IND - Bangalore, India · 15 Nov 2026
B
Senior Lead Product Owner
Boeing Distribution · IND - Bangalore, India · 15 Nov 2026

Collected from US101 Guidehouse's official careers site by LitCareer. Always apply on the employer's own site; LitCareer never charges you to apply.