Bachelor’s degree in Engineering, Computer Science, Statistics, Applied Math, or a related technical field is required plus a minimum of 8 years of relevant experience; or Master's degree plus a minimum of 6 years of relevant experience. Agile experience preferred.
A TS/SCI security clearance with the ability to obtain a Polygraph is required at time of hire. Candidates must be able to obtain the Polygraph within a reasonable amount of time from date of hire. Applicants selected will be subject to a U.S. Government security investigation and must meet eligibility requirements for access to classified information. Due to the nature of work performed within our facilities, U.S. citizenship is required.
Our company has an immediate opening for a Senior Data Engineer on our award-winning Insider Threat Detection Team. A Senior Data Engineer will help us expand our insider threat capabilities in automating data integration and collection strategies. The successful candidate will help expand and optimize the data ingestion pipeline architecture, develop strategies for efficient ingestion, processing, storage, structuring, and access. In addition, the Senior Data Engineer will support data analysts, data scientists, and big data engineers in identifying data sources, performing exploratory data analysis, developing data structures, ensuring data cleanliness and accuracy to provide new Insider Threat behavioral insights.
This position provides an opportunity to further advance the cutting-edge technology that supports some of our nation's core defense/intelligence services and systems. Our company employees work closely with esteemed customers to develop solutions that allow them to carry out high-stakes national security missions.
The majority of work will be performed in Chantilly, Virginia, which is located approximately 25 miles west of Washington D.C., near the Dulles International Airport.
REPRESENTATIVE DUTIES AND TASKS:
Support data science team by designing, developing and implementing scalable ETL process for disparate datasets into a Hadoop infrastructure
Design, develop, implement and maintain data ingestion process from various disparate datasets using StreamSets
Develop processes to identify data drift and malformed records
Modernize the data ingestion architecture
Develop technical documentation and standard operating procedures
Mentor new and junior data engineers
Leads technical tasks for small teams or projects
KNOWLEDGE SKILLS AND ABILITIES:
Working knowledge of entity resolution systems
Experience with messages systems like Kafka
Experience with Python
Experience with NoSQL and/or graph databases like MongoDB or ArangoDB
Any of the following databases: SQL, MongoDB, Oracle, Postgres
Working experience with ETL processing
Working experience with data workflow products like StreamSets or NiFi
Working experience with Python RESTful API services, JDBC
Experience with Hadoop and Hive/Impala
Experience with Cloudera Data Science Workbench is a plus
Understanding of pySpark Leadership experience
Ability to multi-task
Excellent use and understanding of data engineering concepts, principles, and theories
KP RECRUITING GROUP
KP Recruiting Group was started to create a world-wide network of multi-level, highly skilled talent; that are either experts or working to become one, in their respective fields. Our process involves focusing on the talent, skills, and experience of an individual as a key indicator of the present and future value that they will bring to any organization.
In establishing a network, we are able to forge genuine relationships with talent and gain valuable insight that allows us to understand what motivates them. This data allows us to give strategic advice to our partners as they go through the process of managing their human capital.
See our jobs and apply here: https://kprecruitinggroup.catsone.com/careers/7781-General