Spark Jobs in Mclean

Job description- Python, SQL, PySpark Minimum 7 years with Python, SQL and PySpark 5+ years of experience with Spark & Pyspark with Big Data ecosystem tools (e.g. Hadoop, Hive) and data processing within the EDL for big data data pipelines, architectures & data sets

Job description- Python, SQL, PySpark Minimum 7 years with Python, SQL and PySpark 5+ years of experience with Spark & Pyspark with Big Data ecosystem tools (e.g. Hadoop, Hive) and data processing within the EDL for big data data pipelines, architectures & data sets

Python Data Engineer Irving, TX Contract Must have - Python, SQL, PySpark Minimum 7 years with Python, SQL and PySpark 5+ years of experience with Spark & Pyspark with Big Data ecosystem tools (e.g. Hadoop, Hive) and data processing within the EDL for big data data pipe More...

Virtual Networx is looking for Lead Data Engineer for our client located in Mt. Laurel, NJ (On-site from Day 1) Job Type: Full-time Experience: 10-12+ Years Must have skills: Databricks, Python, RDBMS, Powershell scripting, datawarehouse Detailed JD: Experience in ETL/Pi More...

Job Title: Software Developer - Java, Big Data and streaming technologies Location: Philadelphia PA Type: Full Time Job Description: Languages: Java, C/C++ Frameworks: SpringBoot Big Data: Kafka, Spark NoSQL: Cassandra Automation: Gradle, Concourse, Ansible OS: Linux, Shell Scri More...

Job Role-Unix Application Job Description : 1. Good in Unix and shell scripting. 2. knowledge in Bigdata, Hive and Hadoop. And knowledge of SQL is must. The person should have knowledge of querying bigdata tables using hive or impala , also need to have some knowledge about More...

GCP Engineer Location: Austin / Scottsdale (Initial remote for a couple of months) Job Description: Total experience of 6+ years 3 -4 years in Hadoop 1 year in GCP Strong in SQL Spark exp is good to have Work exp in big reputed organization Google certif More...

GCP Data Engineer Location NY Bachelor's Degree in Computer Science or a related discipline 5+ years of applicable engineering experience Strong proficiency in Python with an emphasis in building data pipelines Ability to write complex SQL to perform common types of a More...

Job Description : BS/BA degree or equivalent experience Python development for big data systems Terraform to create infrastructure Experience with structured and unstructured data Plusses Hive, Spark, big data transformation Advanced knowledge of application, data, and infrastruct More...

Role: AWS Data Engineer Location: Remote REQUIRED SKILLS: * Excellent SQL skills, Python( pandas, numpy and pyspark), SPARK * Working experience in AWS data technologies and Databricks * Good understanding of Cloud computing and Big data concepts * Understand and work with multiple More...

Client New York Life Insurance Location Jersey City, NJ Need 2-3 days onsite. Major Skills - AWS Lambda, Glue, ETL, Python / PySpark , SQL. Need with Data Background. Data Pipelines etc. Overall exp should be 10+ years Our client has a very large initiative to migrate More...

Job Title Datastage Developer with quality stage Location Remote (Irving, TX) Employment Type: Contract Duration: 12+ months Client: TCS Job Description: Analyze requirements and existing resources to create efficient database and ETL designs to support system to system More...

MatchPoint Solutions is a fast-growing, young, energetic global IT-Engineering services company with clients across the US. We provide technology solutions to various clients like Uber, Robinhood, Netflix, Airbnb, Google, Sephora, and more! More recently, we have expanded to working i More...

Position - Data Engineer - Location -USA, PA (Up to 2 months remote, later on-site is required) Experience-9+ Years C2H Must Haves: 2+ years of recent experience with Data bricks / Spark / Snowflake and a total of 6+ years in data engineering role. Designing and implem More...

Skill: Bigdata SPARK/SCALA with preferably with AWS Migration Experience. JD: 5+ years of Experience in handling Big Data Environment like Scala, Spark along with AWS Migration. Proficient in understanding and writing Scala Scripts. Strong and good working experience using Spa More...

Mandatory Exp>6-8 yrs , for all below skills. must have skill - Scala , Spark , Mongo Db and kafka and has some exp on any cloud side if has GCP side is plus Profile should have combination of minimum 2 skills role - data engineer - Spark with Python(Mandatory), Airflow, Data Bricks

6+ Years of Industry Work Experience At least 2+ Years of experience in GCP Experience extracting data from a variety of sources, and a desire to expand those skills (working knowledge in SQL and Spark is mandatory) Excellent background in BigQuery and GCP technologies Excellent More...

Hi All, Role: Hadoop Architect Location: Remote Type: W2 Duration: 6+ Months Client: Apex Systems Job Description/Qualifications: Hadoop Environment is current Looking to build out Hadoop- (clusters, installing services, tools, making sure secure for onboarding) 5-7 More...

Data Engineer Lead US (Remote) JD- Experience of End-to-End data platform implementation on Azure platform Understand business processes and how they are modelled in various systems Extensive development experience on Azure Synapse analytics, Azure Data Factory, Data Brick More...

Job Description: Languages: Python and Scala with Spark, R, SQL, familiarity with Golang, C and Java good to have Machine Learning: Scikit-learn, NLTK, Apache Spark ML/MLlib, Keras, Tensorflow Data Mining: WEKA, KNIME, SQL Databases: Oracle, MySQL, DB2, MongoDB, Hadoop HDFS, G More...