Desired Competencies (Technical/Behavioral Competency)
MustHave**
(Ideally should not be more than 35)
1) Strong design and data solutioning skills
2) PySpark handson experience with complex transformations and large dataset handling experience
3) Good command and handson experience in Python. Experience working with following concepts packages and tools
a. Object oriented and functional programming
b. NumPy Pandas Matplotlib requests pytest
c. Jupyter PyCharm and IDLE
d. Conda and Virtual Environment
4) Working experience must with Hive HBase or similar
5) Azure Skills
a. Must have working experience in Azure Data Lake Azure Data Factory Azure Databricks Azure SQL Databases
b. Azure DevOps
c. Azure AD Integration Service Principal Passthru login etc.
d. Networking vnet private links service connections etc.
e. Integrations Event grid Service Bus etc.
6) Database skills
a. Oracle Postgres SQL Server any one database experience
b. Oracle PL/SQL or TSQL experience
Data modelling
GoodtoHave
1) Understanding and experience in Azure Synapse Analytics is a double plus
2) Understanding of Hadoop ecosystem working experience is a plus
NLTK Scikitlearn TensorFlow Keras is a plus
azure sql databases,azure data lake,pandas,azure devops,devops,keras,t-sql,oracle pl/sql,pytest,python,hbase,pyspark,matplotlib,azure databricks,numpy,azure,azure data factory,hive