Loading...

Easy Apply

Please enter a valid email.
Please enter a valid phone number.
Please select a valid country.
Please provide a resume.
You must review and agree before submitting.
NCDPI - Data Engineer - Senior
Typical Experience: 60-84 months

***The max rate for this position is -/hour.
***The manager would like the candidate to be onsite regularly throughout the position. The amount of onsite time per week will be negotiable. However, weekly onsite time will be required.

Job Summary - Data Engineer:

We are seeking a skilled mid-level+ Data Engineer to joinour team and focus on quality assurance, quality checking, and ETL processes.The successful candidate will be responsible for ensuring the integrity andaccuracy of data transferred from a shared file transfer service to an S3bucket and subsequently into and through our Snowflake data platform. This datawill be utilized by downstream applications and reporting systems. Theseapplications and the corresponding consumed data are critical to businessprocess execution.

Key Responsibilities:

  • Quality Assurance & Quality Checking:  Implement and maintain data quality to ensure the accuracy and reliability of data throughout the ETL process.
  • ETL Processes: Design, develop, and optimize ETL workflows to efficiently transfer data from file transfer services to S3 buckets and Snowflake.
  • Data Integration: Ensure seamless data integration into data platform, enabling efficient consumption by downstream applications and reporting tools.
  • Data Quality Management: Address data quality challenges, including inconsistencies in source data that do not meet ingestion requirements, which can lead to load failures or data backouts.
  • Collaboration: Work closely with business owners, data analysts, business intelligence teams, and other stakeholders to understand data requirements and deliver high-quality data solutions.
  • Monitoring & Troubleshooting: To preserve data flow and integrity, monitor pipelines, identify issues, and implement solutions.

 Qualifications (Knowledge/Skills/Abilities):

  • Demonstrated mid-level+ experience in data engineering, with a emphasis on data quality assurance and ETL processes.
  • Expertise in Python, PyPI, and SQL
  • Expert analytical and problem-solving skills.
  • Demonstrate a strong understanding of cybersecurity principles related to code development, DevOps, data access, and fundamental cybersecurity.
  • Understanding of fundamental public-cloud capabilities.
  • Proven capacity to comprehend business needs and convert them into technical requirements.
  • Demonstrated excellence in communication and collaboration abilities.
  • Proven capacity to define success, deliver, and operate in an agile setting.


Required/Desired Skills


SkillRequired /DesiredAmountof Experience
Demonstrated mid-level+ experience in data engineering, with an emphasis on data quality assurance and ETL processes.Required5Years
Expertise in Python, PyPI, and SQLRequired5Years
Demonstrate a strong understanding of cybersecurity principles related to code development, DevOps, data access, and fundamental cybersecurity.Required5Years
Understanding of fundamental public-cloud capabilities.Required5Years
Proven capacity to comprehend business needs and convert them into technical requirements.Required5Years

Questions


No.Question
Question1Absences greater than two weeks MUST be approved by CAI management in advance, and contact information must be provided to CAI so that the resource can be reached during his or her absence. The Client has the right to dismiss the resource if he or she does not return to work by the agreed upon date. Do you agree to this requirement?
Question2This is a hybrid position. The manager and candidate will discuss how often the candidate needs to be onsite. However, the candidate will be expected onsite weekly. Do you agree to this requirement?
Question3What is your candidate's email address?
Question4How soon can your candidate start if selected for this opportunity?
Question5Vendors are encouraged to submit candidates that are available for the duration of the assignment.  Do you anticipate your candidate being able to work until the proposed end date listed on this VectorVMS req?
Question6Vendors must disclose to the agency if the candidate will be subcontracted at the time of submission.  Is your candidate an employee of your company or a subcontractor?  Please be sure to notify a CAI Account Manager if your candidate's employee status changes.
Question7Vendors must notify the agency if any portion of the requirements listed in this task order will be outsourced to other countries.  Do you anticipate outsourcing any work being done for this assignment to another country?
Question8Candidates submitted above the hourly Vendor Rate of - may not be considered for this assignment.  Do you agree to this requirement?
Question9Payment for all approved hours will be paid at the straight hourly rate regardless of the total hours worked by the engaged resource.  It is the responsibility of the Vendor to adhere to any applicable compensation laws including payment for overtime hours.  Do you agree to this requirement?
Question10Have you thoroughly validated, and attest to the accuracy of, the credentials listed throughout your candidate’s VectorVMS profile and resume pursuant to Section 5.2.5 of ITS-009440?