Etl Lead Developer Resume
Charlotte, NC
SUMMARY
- 11+ years of experiencein Analysis/Design/Development/Implementation of ETL/DWH projects.
- Proficient in Data analysis, Data modeling, Database design and Data migration.
- Extensive work experience on integrating, coordinating and leading onshore - offshore team model.
- Experience in Data Analysis, Design, Development, Implementation and Testing of Database/Data warehousing/Client/Server/Legacy applications using Data Modeling, Data Extraction, Data Transformation, Data Loading and Data Analysis.
- Strong working experience on Data Warehousing applications, directly responsible for the Extraction, Transformation and Loading (ETL) of data from multiple sources into Data Warehouse.
- Understanding of design and implementation of Star, Snowflake schemas and multi-dimensional modeling.
- Worked on Unix- based, Windows based and Mainframe-based Warehouse environments.
- Experience in integration of various data sources like SQL Server, Oracle, Sybase, MS Access and Flat Files into staging area and sound knowledge onDataStage/Unix/Windows based ETL development and performance tuning.
- Thorough experience inunit testing, system integration testing, UAT, implementation, maintenanceandperformance tuning.
- Proficiency in data warehousing techniques fordata cleansing,Slowly Changing Dimension Type II phenomenon,surrogate key assignmentandchange data capture.
- Hands on Experience inUNIX Shell Scripting.
- Worked extensively on different types of stages likeJoin, Lookup, ODBC, Aggregator, DB2UDB, Transformer, Merge, Sort, Pivot, FTP, Change Data Capture(CDC), Filter, Unstructured data, Modify, MQ Connector, XML out, Shared Containers, generic stagesfor developing jobs.
- Unique ability to understand long-term project development issues at all levels, from interpersonal relationships to the details of coding scripts with strong analytical, organizational, presentation and problem solving skills.
- Worked on multi-vendor multi-sourcing models (including offshoring)
- Excellent communication and interpersonal skills and strong ability to perform as part of a team and individually.
TECHNICAL SKILLS
Domain: Data warehousing/ETL, Banking/Cards, Financial/Fund Management
Environment: s UNIX, WINDOWS, O/S 390, MVS
ETL Tools: DataStage ( Versions 7.5, 8.0, 8.1, 8.5, 9.1), FastTrack
Languages: Shell scripting, COBOL, JCL, SQL
Databases: Oracle 10g, Teradata,SQL Server, DB2 UDB, DB2 O/S 390
Versioning: TFS, Borland Star Team, SCCS, Changeman, Endeavor, Clearcase
Scheduling: Autosys, Tivoli Maestro, CA7
Methodologies: Agile, Waterfall
Other Tools: Quality Centre, FileAID, SAR
PROFESSIONAL EXPERIENCE
Confidential, Charlotte, NC
ETL Lead Developer
Responsibilities:
- Accessing data from Oracle/SQL Server/Linux application using various ETL stages and designing different jobs for extracting, transforming and loading the data.
- This project contains two environments Datastage 8.0 Server version under Windows and Data stage 9.1 parallel edition under UNIX
- Working on sun setting 8.0 and moving the entire application to 9.1 along with new requirements and design.
- Involved multiple job sequences, exec command/transformer/lookup/filter/aggregate/join stages/CDC stages, unstructured data.
- Created newUnixmaintenance/scripts to set up environment forDataStagejobs.
- Worked closely with ETL Architect, DBAs and business team in finalizing the requirements and in preparing the ETL Technical design document
- Set up and configureAutosysscheduling tasks to run batch ETL processes developed in DataStage and created scripts for the NDM process.
- Develop all documentation like Technical Design Doc, Unit Test/System Test scripts, Source-To-Target mapping documents etc.
- Code migration and version control using TFS across Development, IT and Production environments.
- UsedDataStageDirectorand its runtime engine for testing and debugging its components, and monitoring the results executable versions (on an ad hoc basis).
Confidential, Charlotte, NC
ETL Lead Developer
Responsibilities:
- Accessing data from Mainframe/Linux application using various ETL stages and designing different jobs for extracting, transforming and loading the data using Agile methodology.
- Job design Involved multiple job sequences, exec command/transformer/lookup/filter/join stages/CDC stages to convert the Mainframe code into Datastage for handling the delta file load.
- Develop newUnixmaintenance/scripts to support the new environment forDataStagejobs.
- Worked closely with ETL Architect in finalizing the requirements and in preparing the ETL Technical design document
- Set up and configureAutosysscheduling tasks to run batch ETL processes developed in DataStage.
- Develop all documentation like Technical Design Doc, Unit Test/System Test scripts, Source-To-Target mapping documents etc. Code migration and version control usingClearcaseacross Development, IT and Production environments for the entire EDW.
Environment: Linux, DB2, IBM WebSphere DataStage 8.5 (Designer, Director, Administrator), TOAD 8.6, SQL, Windows 2003/XP, UNIX-SUNOS 5.10, SHELL SCRIPTING, Clearcase, FastTrack, Quality Center.
Confidential
ETL Lead Developer
Responsibilities:
- Participated in the JAD session and joined hands with business teams across multiple platforms and verticals to identify application unit’s role along with the support of project BA.
- Single handedly created the whole business requirements and technical requirements to accomplish the process involved multiple job sequences, exec command/transformer/lookup/filter/join stages/CDC stages.
- Coordinated the offshore and the business to tackle the final requirement and coding which was on a very tight schedule and has to be made available to the public which includes all Confidential customers.
- Develop all documentation like Technical Design Doc, Unit Test/System Test scripts, Source-To-Target mapping documents etc.
Environment: Linux, Oracle, DB2, IBM WebSphere DataStage 8.5 (Designer, Director, Administrator), TOAD 8.6, SQL, Windows 2003/XP, UNIX-SUNOS 5.10, SHELL SCRIPTING, Clearcase, FastTrack.
Confidential
ETL Lead Developer
Responsibilities:
- Worked on ETL process which involves multiple high volume input files and data loaded into various source tables
- Involved multiple job sequences, exec command/transformer/lookup/filter/join stages/CDC stages and working on NDM process and scripts.
- Worked coordinating multiple vendors like TCS, Infosys and
- Worked closely with business analysist in achieving the target and following the dates for the delivery which happened on a regular basis.
- Set up and configureAutosysscheduling tasks to run batch ETL processes developed in DataStage and ran jobs in UAT on a manual schedule on requirements from the business.
- Develop all documentation like Technical Design Doc, Unit Test/System Test scripts, Source-To-Target mapping documents etc.
- Code migration and version control usingClearcaseacross Development, IT and Production environments for the entire EDW.
Environment: Linux, Oracle, DB2, IBM WebSphere DataStage 8.5 (Designer, Director, Administrator), TOAD 8.6, SQL, Windows 2003/XP, UNIX-SUNOS 5.10, SHELL SCRIPTING, Clearcase. NDM process.
Confidential, Charlotte, NC
ETL Developer
Responsibilities:
- The Banking project is a new initiative started by TIAA-CREF for starting Banking for its existing customers as well as for the new customers. Data is integrated from external systems like FIS and passed on to the CLTS system.
- This data is loaded into the Staging area which is in Oracle database and the exceptions will be loaded into a Teradata database which is under a common schema for all the Banking initiatives that is happening and may happen in future.
- The data will be unloaded from the staging area at a later stage and will besendto the CTLS system after applying the necessary rules and constraints as specified by the Source and the target systems.
- Create newDataStagejobs, reusable containers and Job Sequences to replicate the data integration for EDW.
- Setup and configureAutosysscheduling tasks to run batch ETL processes developed in DataStage.
- Ensure any data integrity rules imposed by the Target system are integrated flawlessly into the output system usingDataStageand Oracle.
- Code migration and version control usingStarTeamacross Development, IT and Production environments for the entire EDW.
- Second project was a Data Scrambling project where the data from production which is present in the Teradata is moved to an Oracle Database which is in System Test environment for scrambling .Once the scrambling is done the data has to be moved from Oracle to Teradata
- TeradataMulti loadStage was used to accomplish these functions.
- Develop all documentation like Technical Design Doc, Unit Test/System Test scripts, Source-To-Target mapping documents etc.
- Code migration and version control using Borland Star Team across Development, IT environments.
Environment: AIX, Teradata, Oracle, IBM WebSphere DataStage 8.1(Designer, Director, Administrator), TOAD 8.6, SQL, Windows 2003/XP, UNIX-SUNOS 5.10, SHELL SCRIPTING
Confidential, Charlotte, NC
Responsibilities:
- Tune the existing jobs for better performance.
- Developed jobs for file validation using UNIX script as a preprocess before being handled by datastage.
- Code migration and version control usingStarTeamacross Development, IT and Production environments for the entire EDW.
Environment: AIX, Teradata, Oracle, IBM WebSphere DataStage 8.1(Designer, Director, Administrator), TOAD 8.6, SQL, Windows 2003/XP, UNIX-SUNOS 5.10, SHELL SCRIPTING
Confidential, Charlotte, NC
Responsibilities:
- Extracting data from Mainframe warehouse using CFF stage andperlscripts invoked byDataStage
- Aggregation and transformation stages involved before loading to final aggregated tables.
- Integrate data from various sources like Oracle, Legacy Systems (VSAM/Adabas/DB2) andTeradatainto the main Teradata EDW.
- Ensure any data integrity rules imposed on the existing legacy platformareintegrated flawlessly into the new EDW usingDataStageandTeradata.
- Develop all documentation like Technical Design Doc, UnitTest/System Test scripts, Source-To-Target mapping documents etc.
- Code migration and version control using StarTeam across Development, IT and Production environments for the entire EDW.
Environment: AIX, Teradata, Oracle, IBM WebSphere DataStage 8.1(Designer, Director, Administrator), TOAD 8.6, SQL, Windows 2003/XP, UNIX-SUNOS 5.10, SHELL SCRIPTING
Confidential, Dallas, TX
ETL Technical Lead Developer
Responsibilities:
- Designed the ETL jobs usingIBMWebsphere DatastageServer Edition 8.1to Extract, Transform and load the data into Staging and then into Oracle Database.
- Developed source-to-staging ETL jobs that perform basic syntactical/technical data type validation.
- TheSourcefor the project wasanotherdata warehouse that was hosted on mainframe.
- TheTargetfor the project was an external vendor called Axiom.
- Design and development of Extract, Transform, and Load processes for extracting data Oracle, Mainframe, Flat Files etc. from various systems and loading into DB2 UDB tables, Oracle tables, Flat file etc.
- Developed multiple jobs where the source wasCOBOLfile & performed number of validations using hash files & moved the data to Oracle environment.
- DevelopedSQL Queryto perform Joins on three tables & used inOracle ConnectorStage for ETL Jobs.
- Extensively usedOracle Connector Stage, Transformer Stage, CFF Stage, Sequential File Stage, Aggregator Stage, and Pivot Stage.
- UsedLookup Stageto look up the code table for verifying the codes from the incoming file.
- Extensively defined & usedStage Variables and Constraintsin Transformer stage for many ETL Jobs.
- Designed Sequencer to synchronize the control flow of multiple activities in ajob sequence
- Involved in Performance tuning of all the ETL jobs in production environment.
- Created UNIX scripts for file transfers (FTP) and to callDatastagejobs.
- DevelopedSource to Target mapping documentfor all the ETL jobs including theTest Cases.
- Worked withTOADto interact with Oracle and used the tool for testing
- Involved in fine tuning, troubleshooting, bug fixing, defect analysis and enhancement of the multipleDataStagejobs
Environment: AIX, DB2, Oracle, IBM WebSphere DataStage 8.1(Designer, Director, Manager, Administrator), TOAD 8.6, SQL, Windows 2003/XP, UNIX-SUNOS 5.10, SHELL SCRIPTING, COBOL FILE.
Confidential, Dallas, TX
ETL Developer
Responsibilities:
- Developed and implemented newDataStageETL process end-to-end
- Extensively usedDataStageDesigner to design, develop ETL jobs for extracting, transforming and loading the data
- Developed various jobs to read from Complex Flat Files from source system, Flat Files and Database, transform and load to Target databases
- Used stages such asMQ connector stage.
- Worked with QC and Prod Support teams and bug fix and followed-up with QC-Tickets.
- Extracted data from various source systems like Oracle, SQL Server, and Flat Files.
- Createdsequencersto sequentially execute the designed jobs.
- Written various Unix Shell Scripts for scheduling and formatting the files.
- Automated the process to remove hard coded values from Tivoli Maestro which was a value-add.
- Design, Testing/Documentation and test plan review
Environment: AIX, DataStage, SQL, Base SAS, DB2 UDB, Oracle
Confidential, Dallas, TX
ETL Technical Lead
Responsibilities:
- Act as single point of contact for the client. Managed a team of offshore developers.
- ModifyTransformation stage for jobs and Metadata for existing job/job sequence
- Thorough regression testing to ensure zero fall back to the existing process
- Performance tuned some of the Production ETL components
- Testing and implementation of changes
Environment: AIX, z/OS, DataStage 8.0, SQL, DB2 UDB, Oracle
Confidential, Dallas, TX
ETL Datastage Developer
Responsibilities:
- Developer (end-to-end implementation) for Basel II project usingMainframe Technologiesfor Consumer Cards.
- Worked extensively on SPUFI, SAR,FILAID.
- Ensure compatibility with similar sourcing done for Basel II onUnix Warehouse (known as Bacardi DWH) for Business Cards usingDataStageas ETL tool
- Analyzed Unix Shell scripting.
- Development of LLD, Traceability Matrix, Code, Test Scripts
- Test plan reviews, UTRs, Data file preparation for SIT
- Production Implementation & Job Monitoring
Environment: OS/390, AIX, DB2, DB2 UDB, Oracle, DataStage, Shell scripting, Base SAS, SQL
Confidential, Dallas, TX
Responsibilities:
- Implement code fix for the KTC Warehouse usingMainframe Technologies
- UsedSPUFI,FILA,SAR,JCLandCOBOLprograms for analysis and understanding of the system.
- Wrote COBOL programs to read data from DB2 and sending data to the downstream systems.
- Job monitoring usingCA7.
- Small enhancements to the DWH.
- Documentation of tickets, resolution and RCA.
Environment: OS/390, COBOL, JCL
Confidential
Java Developer
Responsibilities:
- Analyze, Design and Develop code components for backend groups
- Developed new components using Java.
- Modified existing components for fixes and changes in business logic.
- Introduced new documentation wherever applicable
Environment: UNIX, Shell scripting, Oracle, SQL, Java
Confidential
UNIX programmer
Responsibilities:
- Analyze, Design and Develop code components for backend groups
- Developed new components using shell scripts.
- Modified existing components for fixes and changes in business logic
- Introduced new documentation wherever applicable
Environment: UNIX, Shell scripting, SQL, Oracle