SQL Developer with ETL Experience
SQL Developer with ETL Experience
Posted on :
20-11-2024
Employer Active
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Share
Send me jobs like this
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Job Description
SQL Server Developer with 10 years experiences
Job Title: SQL Developer with ETL experience
Location: Coimbatore
Position Overview: We are looking for an experienced ETL Developer to join our team. The ideal candidate will have a minimum of 6 years of handson experience in SQL development with exposure to ETL process for 3 years (latest) and ETL tools for migrating the data from one system to another. Developer will be responsible for designing implementing ETL pipelines and designing developing and maintaining complex SQL queries and procedures to support critical business applications. Additionally the candidate shall have experience in database architecture and be capable of providing technical leadership in optimizing SQL code for maximum performance.
Key Responsibilities:
Data Management and Storage:
o Design and implement data storage solutions using Azure services like Azure SQL Database Azure Data Lake Storage and some experience of Azure Cosmos DB.
o Ensure data storage systems are scalable performant and costeffective.
o Perform database performance tuning and optimization including query optimization index tuning and database configuration would be an advantage
o Write Unit Tests for database objects like stored procedures.
Data Integration and ETL:
o Develop and manage ETL (Extract Transform Load) processes using Azure Data Factory to integrate data from various sources.
o Ensure data is efficiently cleaned transformed and loaded into data warehouses or data lakes.
o Gather and process raw data at scale (including writing scripts web sing calling APIs write SQL queries writing applications and good knowledge of Entity Framework)
o Primarily use the skills above to perform multiple data migrations from existing operational systems or data extracts into our live multitenanted system to tight deadlines with minimal operational downtime.
o Investigating data to anticipate any pipeline issues.
Big Data and Analytics:
o Utilize big data technologies such as Azure Databricks and Apache Spark for data processing and analytics.
o Create data processing workflows and pipelines to support data analytics and machine learning applications.
o Use Power BI and Embedded Power BI to visualise the data and create insights to effect Operational process improvements.
Data Security and Governance:
o Implement data security measures and ensure compliance with data governance policies.
o Monitor and optimise data storage and processing solutions for security and performance.
Collaboration and Troubleshooting:
o Work closely with data developers migration experts data scientists analysts and other stakeholders to understand data requirements and create effective data workflows and database schemas.
o Identify and troubleshoot operational and data quality issues and assist our development and support teams in identifying and rectifying production data issues
Collaboration and amp;amp; Upskilling:
o Stay abreast of emerging trends and technologies.
o Document database design schema and procedures
Requirements:
Minimum of 3 years of handson experience in Azure services like Azure SQL Database Azure Data Lake Storage and some experience of Azure Cosmos DB.
Expert level proficiency in ETL process and tools like SSIS or ADF.
Experience with data assessments mapping data between data structures and matching data to new data structures data modelling and amp;amp; data quality management.
Experience with effective resource management risk identification and management and progress monitoring.
Expertlevel proficiency in SQL programming and database concepts.
Experience in performance tuning and optimization techniques.
Strong analytical and problemsolving skills.
Experience in database projects and DACPAC.
Experience with TsqlT Unit Tests or database unit test concept.
Ability to work independently and in a team environment.
Experience in powerbi report creation is added advantage.
Familiarity with database management systems such as MySQL PostgreSQL is a plus.
Familiarity with azure service like cosmos db synaps analytical service is a plus.
Experience with Azure data services including Azure Data Factory Azure Synapse Analytics Azure Stream Analytics and Azure Event Hubs
Strong understanding of data architecture patterns and parallel processing
Certifications:
Microsoft Certified: Azure Data Engineer Associate: This certification demonstrates expertise in integrating transforming and consolidating data from various structured unstructured and streaming data systems.
Employment Type
Full Time
Key Skills
Report This Job
Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.
