This job board retrieves part of its jobs from: Toronto Jobs | Emplois Montréal | IT Jobs Canada

The hottest job offers in the state of Virgina

To post a job, login or create an account |  Post a Job

Data Engineer

Waynsys Inc.

This is a Contract position in Henrico County, VA posted March 26, 2020.

Job Description For these roles you will have the opportunity to work on a highly visible and integral project for our client. You will be tasked with the following Take the current SSIS ETL processes, then build the data pipelines and schema. Use Azure Data Factory (ADF) to create new data pipelines based on SSIS. Modify ETL in SSIS packages to run in Azure Data Factory or Recreate in ADF. Use SSIS, Azure Data Factory, and DataBricks to build solutions in Azure cloud. Data Engineer Responsibilities Create and maintain optimal data pipeline architecture for enterprise big data and analytics in a cloud based big data environment. Design and assemble large, complex data sets that meet functional non-functional business requirements. Implement internal process improvements in data analytics automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc. Build the infrastructure and workflows required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and big data technologies. Build analytics applications that utilize the data pipeline to provide actionable insights into key business performance metrics. Create tools and processes to keep sensitive data, including PHI and PII data separated and secure across clients. Work with data and analytics experts to strive for greater functionality in data systems to help make our client a market leader in big data. Data Engineer Requirements Advanced SQL query skills SSIS experience building ETL pipelines Azure Data Factory (ADF) HIPPAHealthcare experience and knowledge Data Engineer Pluses (Not Required) DataBricks (Azure or Cloudera) PySpark or Python for DataBricks PowerBI or Tableau experience Hadoop .NET development experience DevOps – source control, etc.