pyspark, spark, hadoop, bigdata, etl, sql, shell scripting
Full Time
$85,000 - $90,000
Work from home available
Title: Big Data Developer
Duration: Full time
Location: Tampa, FL
Required Skills:
• 8+ Experience with Big Data, Hadoop on Data Warehousing or Data Integration projects.
• Analysis, Design, development, support and Enhancements of ETL/ELT in data warehouse environment with Cloudera Bigdata Technologies (Hadoop, MapReduce, Sqoop, PySpark, Spark, HDFS, Hive, , Sentry) along with Oracle SQL/PL-SQL, Unix commands and shell scripting.
• Writing Hive scripts for gathering stats on table post data loads.
• Strong SQL experience (Oracle and Hadoop (Hive))
• Proven ability to write high quality code.
• Expertise implementing complex ETL/ELT logic.
• Develop and enforce strong reconciliation process.
• Accountable for ETL/ELT design documentation.
• Good knowledge of Big Data, Hadoop, Hive, Impala database, data security and dimensional model design.
• Basic knowledge of UNIX/LINUX shell scripting.
• Utilize ETL/ELT standards and practices towards establishing and following centralized metadata repository.
• Effective communication, presentation, & organizational skills.
• Familiar with Project Management methodologies like Waterfall and Agile
• Ability to establish priorities & follow through on projects, paying close attention to detail with minimal supervision.