Informatica/Hadoop Developer
Strong hands-on experience in Informatica PowerCenter (Designer, Workflow Manager, Workflow Monitor, Repository Manager) for ETL design and development.Experience building mappings, mapplets, sessions, worklets and workflows to load data from multiple sources into target systems.Proficiency with core transformations: Source Qualifier, Expression, Lookup, Joiner, Router, Aggregator, Sorter, Union, Normalizer and Update Strategy.Experience with reusable transformations, parameter files, mapping variables and dynamic workflow design.Knowledge of SCD Type 1, Type 2 and Type 3 implementation, incremental/delta loads and CDC techniques.Experience with Informatica performance tuning: pushdown optimization, partitioning, caching and session tuning.Ability to implement error handling, audit, restartability and reconciliation frameworks in Informatica workflows.Working knowledge of Informatica IDQ / Data Quality and Informatica IICS / Cloud Data Integration is an advantage.Experience in Informatica Administration basics: repository, integration service, connections and job scheduling and monitoring.Hands-on experience with Hadoop ecosystem components: HDFS, YARN, MapReduce, Hive, Pig, Sqoop, Oozie and HBase.Strong understanding of HDFS architecture: NameNode, DataNode, block replication, and file formats and compression (Parquet, ORC, Avro, Snappy).Strong hands-on experience writing and optimizing HiveQL queries, including partitioning, bucketing and external/managed tables.Experience with Apache Spark (PySpark / Spark SQL / Scala) for large-scale data processing on Hadoop.Experience scheduling and orchestrating Hadoop jobs using Oozie, Control-M or Autosys.Experience integrating Informatica BDM / Big Data Management with Hadoop clusters (Hive, HDFS, Spark execution engine).Understanding of Kafka and streaming / near real-time data ingestion into the Hadoop data lake.Knowledge of data lake architecture: landing, raw, curated and consumption zones on Hadoop.Experience with NoSQL databases such as HBase or Cassandra for large-volume data storage.Strong SQL / Teradata / Oracl e skills for source analysis, data validation and ETL unit testing.Proficiency in Unix/Linux shell scripting for file handling, job automation and log analysis.Experience in Hadoop performance tuning and troubleshooting failed jobs, system memory utilization and resource issues using YARN and Spark UIs.Knowledge of Hadoop security: Kerberos, Ranger / Sentry, encryption and data masking for sensitive banking data.Experience with version control and CI/CD tools (Git, Jenkins) for ETL and Hadoop code deployment.Ability to prepare technical design documents, source-to-target mappings and unit test cases, and support UAT and production deployments.Salary Range- $115,000-$125,000 a year
Location
Charlotte, NC
Function
TECHNOLOGY
Role
Engineer
ID
438971
Skills
Informatica
Salary Range
$115,000 - $125,000