Sr Data Engineer Local to Minnesota - W2
Sr Data Engineer Local to Minnesota - W2
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
INR INR 6000000 - 6500000
1 Vacancy
Job Description
- Design and implement scalable data pipelines to process large volumes of data.
- Develop test and maintain ETL processes to ensure timely data availability.
- Manage and optimize data storage solutions including data warehouses and lakes.
- Work collaboratively with data scientists to enable advanced analytics.
- Perform data modeling and schema design to facilitate efficient data retrieval.
- Ensure data quality and integrity through validation and monitoring processes.
- Leverage cloud technologies such as AWS Azure or GCP for data solutions.
- Create and maintain documentation related to data processes and architecture.
- Participate in code reviews to promote best practices within the engineering team.
- Implement security measures to protect sensitive data and comply with regulatory standards.
- Analyze and resolve performance issues in data processing workflows.
- Stay current with industry trends and emerging technologies in data engineering.
- Assist in mentoring junior data engineers in technical skills and best practices.
- Communicate effectively with stakeholders to gather requirements and provide updates.
- Conduct impact analysis of new data initiatives and propose optimization strategies.
- Bachelors or Masters degree in Computer Science Information Technology or a related field.
- Minimum of 5 years of experience in data engineering or a similar role.
- Proficiency in SQL and experience with relational databases like PostgreSQL MySQL.
- Strong programming skills in Python; familiarity with Java or Scala is a plus.
- Experience with big data technologies such as Hadoop Spark or Kafka.
- Solid understanding of data warehousing concepts and practices.
- Handson experience with cloud data solutions (AWS Azure GCP).
- Knowledge of data quality and governance best practices.
- Ability to work in a fastpaced collaborative team environment.
- Strong analytical and problemsolving skills.
- Familiarity with version control systems like Git.
- Excellent communication skills both verbal and written.
- Aptitude for mentoring and guiding less experienced team members.
- Experience in Agile methodologies is advantageous.
- Ability to adapt to changing business needs and priorities.
- Certification in relevant data engineering tools and platforms is a bonus.
python,batch processing,sql,agile methodologies,sql proficiency,data warehousing,data engineering,etl processes,azure,cloud technologies,data modeling,big data technologies,governance,data quality,version control systems
Employment Type
Full Time
Company Industry
Key Skills
- Apache Hive
- S3
- Hadoop
- Redshift
- Spark
- AWS
- Apache Pig
- NoSQL
- Big Data
- Data Warehouse
- Kafka
- Scala
