Senior Big Data Engineer at Nyla Technology Solutions
Overview
Nyla Technology Solutions seeks a Senior Big Data Engineer in Annapolis Junction MD to design and sustain distributed big data infrastructure. This role involves leading data warehouse architectures and processing pipelines while maintaining peak performance and reliability.
What You'll Do11
- 1Design and maintain Hadoop MapReduce Accumulo ZooKeeper infrastructure
- 2Develop Java MapReduce applications and custom Accumulo iterators and scanners
- 3Troubleshoot cluster failures such as node offlining and disk issues
- 4Create and run Ansible playbooks for workload deployment and Kubernetes management
- 5Optimize Accumulo schema designs for large-scale analytical queries
- 6Author custom Helm charts and operators for Kubernetes orchestration
- 7Implement Linux system administration practices for big data storage nodes
- 8Integrate GitLab CI/CD or Jenkins pipelines for automated testing
- 9Manage containerized workloads and perform low-level Linux kernel tuning
- 10Drive continuous improvement of data processing workflows and pipelines
- 11Collaborate with cross-functional teams to deliver mission-critical solutions
Requirements8
- 15+ years building ETL pipelines with Spark and Airflow
- 2Bachelor’s Degree in Computer Science or related field with 7+ years professional experience
- 3Master’s Degree in related field with 5+ years specialized experience
- 4Advanced Kubernetes Orchestration experience with Helm chart and operator development
- 5Deep Linux system administration skills with advanced Bash scripting and kernel tuning
- 6Proven track record of designing high-throughput data warehouse processing systems
- 7Expertise in CI/CD automation using GitLab CI/CD or Jenkins platforms
- 8Specialized knowledge in Accumulo schema optimization and tablet distribution strategies
Salary Insight
$186 - $220k per year
Location
Required Skills
Similar open positions
Explore active roles that match your skills and interests.
Nyla Technology Solutions
VerifiedSenior Systems Engineer Nyla Technology Solutions
We seek an energetic Systems Engineer to lead system requirement specifications and Agile execution in Annapolis Junction MD. This role drives sprint planning facilitates technical customer engagement and partners with DevOps to maintain build pipelines. Ideal candidates bring structure to complex software efforts and ensure technical integrity across high visibility deployments.
Nyla Technology Solutions
VerifiedMid-Level Systems Engineer - Nyla Technology Solutions
Nyla Technology Solutions seeks a seasoned Systems Engineer Level 2 for ANCAPS clearance in Annapolis Junction MD. This role owns system architecture and privacy compliance from CONOP extraction to DoDAF architectures. You will bridge operational end-users software teams and government leadership. Expect leadership in system integration performance budgets and SOA cloud-native solutions aligned with legal privacy standards. Ideal candidates transform complex operational needs into hardened engineering baselines.
Finoit Inc.
VerifiedSenior Software Engineer Data Infrastructure
Design and lead development of scalable data pipelines for AI/ML platforms. Own design and implementation of distributed systems using Python and cloud services. Drive improvements in data quality and visualization. Lead cross-functional teams to deliver high-performance solutions.
Cyma Systems Inc
VerifiedBig Data Engineer at Cyma Systems Inc Washington DC Contract
Own large scale data infrastructure at Cyma Systems Inc in Washington DC as a Big Data Engineer. Lead development of scalable solutions using Apache Spark Hadoop Ecosystem Scala Hive Python Perl Complex SQL AWS S3 EMR Glue Athena GitHub CI CD Pipelines. Drive agile methodologies test automation AI tools GitHub Copilot ChatGPT Amazon Q Prompt Engineering. Differentiate by shaping cloud native architecture.
2755 Barclays Services Corpor
VerifiedSenior Data Engineer AVP - Cloud Data Pipelines & Warehouses
Lead the design and execution of enterprise-grade Java data pipelines and warehouses to ensure accurate accessible secure data. Build and maintain robust systems for ingestion transformation and storage across large volumes. Drive optimization of pipeline performance and collaborate with cross-functional teams. Shape data governance and compliance while mentoring technical staff. Seeking a leader who can influence decision making and foster a culture of excellence.
GRVTY
VerifiedSenior Software Engineer GRVTY Washington DC
GRVTY seeks a Software Engineer with TS/SCI clearance to lead data science initiatives supporting complex analytics challenges. This role involves developing operational prototypes using advanced data science techniques across behavioral geo-temporal social and content analysis within scalable cloud environments. The ideal candidate will research machine learning and statistics advancements for mission-critical problems. Telework options up to two days weekly are available.