Data Engineer - II (FTC), DAVENGERS(Data Avengers)
As a data engineer are you looking for opportunity to be among software developers, machine learning scientists to build a data platform that not only caters to BI and reporting but also extends to machine learning applications?
As a data engineer in AEE, you will: - Design, implement and support an analytical data infrastructure serving both business intelligence and machine learning applications
As a data engineer in AEE, you will: - Design, implement and support an analytical data infrastructure serving both business intelligence and machine learning applications
- Managing AWS resources including EC2,Redshift,EMR-Spark etc
- Collaborate with applied scientist to integrate and build data pipeline as necessary for building and training machine learning models in AEE
- Collaborate with Product Managers, Financial and Business analysts to recognize and help adopt best practices in reporting and analysis: data integrity, test design, analysis, validation, and documentation
- Interface with other technology teams to extract, transform, and load data from a wide variety of data sources using SQL and AWS big data technologies
- Explore and learn the latest AWS technologies to provide new capabilities and increase efficiency
- Collaborate with other tech teams to implement advanced analytics algorithms that exploit our rich datasets for statistical analysis, prediction, clustering and machine learning
- Help continually improve ongoing reporting and analysis processes, automating or simplifying self-service support for customers
Basic Qualifications
- 3+ years of data engineering experience
- Experience with data modeling, warehousing and building ETL pipelines
- Experience with SQL
Preferred Qualifications
- Experience with AWS technologies like Redshift, S3, AWS Glue, EMR, Kinesis, FireHose, Lambda, and IAM roles and permissions
- Experience with non-relational databases / data stores (object storage, document or key-value stores, graph databases, column-family databases)