Data Engineer

Role summary / purpose Support or collaborate with application developers, database architects, data analysts and data scientists to ensure optimal data delivery architecture throughout ongoing projects and operations. Design, build, and manage analytics infrastructure that enables functions of the big data platform for Analytics. Key responsibilities • Develop, construct, test, and maintain architectures, such as databases and large-scale processing systems that help analyze and process data according to organizational requirements • Develop highly scalable data management interfaces and software components by employing programming languages and tools • Work closely with Data Science staff to take existing or new models and convert them into scalable analytical solutions • Design, document, build, test and deploy data pipelines that assemble large complex datasets from various sources and integrate them into a unified view • Identify, design, and implement operational improvements including automating manual processes, data quality checks, error handling and recovery, and re-designing infrastructure as needed • Create data models that allow analytics and business teams to derive insights about customer behaviors • Build new data pipelines, identify existing data gaps and provide automated solutions to deliver analytical capabilities and enriched data to applications • Obtain data from the System of Record and establish batch or real-time data feeds to provide analysis in an automated fashion • Develop techniques supporting trending and analytic decision making processes • Apply technologies for responsive front-end experience • Ensure systems meet business requirements and industry practices • Research opportunities for data acquisition and new uses for existing data • Develop data set processes for data modeling, mining and production • Integrate data management technologies and software engineering tools into existing structures Requirements – education & experience • Degree in Computer Science, Engineering, or related fields • 3-5 years of experience Required skills • Programming languages and scripting languages • Data pipeline design and deployment • Database architecture and management • Data modeling and analytics