Data Stage Developer Resume
CA
SUMMARY
- Over 6 years of IT experience in Analysis, Design, Development, Implementation, and Testing of Client/Server, and Data Warehousing & OLAP Applications using ETL Tools.
- Extensive experience using Data Stage stages such as Lookup, Join, Merge, Funnel, Remove duplicates, Aggregator, DB2 Enterprise, Oracle Enterprise, Sequential file, Dataset, File Set.
- Extensive experience with data warehousing and business intelligence applications with participation in entire life cycle of projects.
- Extensive knowledge in Pipeline/Partition concepts and techniques - Round Robin, Entire, Hash by Field, Modulus and Range.
- Experience with ETL design and development of Data Marts /Enterprise wide Data Warehouses / Operational Data Stores.
- Proficiency in object-oriented PERL including Moose
- Used job Sequencer to specify the network/sequence of jobs to run.
- Extensive knowledge and experience in various parallel stages (Sort, Merge, Aggregator, and Transformer, Funnel, Filter, Look-up, Surrogate Key, Remove Duplicate, Transformer, Column/Row Generator and Peek) and Mainframe stages (Aggregator, Join, Look-up, Fixed Width Flat File).
- Experience of PERL for File handling and Regular expressions for parsing sensitive information and DBI/DBD module for Sybase connection from PERL scripts for information storage.
- Excellent skills in the development of Extraction, Transformation and Loading (ETL) solutions to meet the business needs of our clients and in providing technical leadership to outsourcing team members.
- Worked with varied Stages like Lookup, Join Merge, Sort, Copy, Filter, Transformer, Aggregator and Funnel Stage.
- Proficient in Teradata Database Design (Physical and Logical), Application Support, Performance Tuning, Optimization, User & Security Administration, Data Administration and setting up the environments.
- Monitoring Teradata CPU/Load utilization, Space Management and System Health Trend periodically for the future enhancements and pipeline projects.
- Worked on Teradata View point, Teradata PDCR to monitor the systems and also to generate various performance and system related reports
- Worked on Complex data coming from Mainframes (EBCIDIC files) and knowledge of Job Control Language (JCL)
- Extensively Worked on IBM InfoSphere Classic Federation Server which provides SQL access to mainframe databases and files without mainframes programming.
- Mapped Logical relational table structures to existing physical mainframes databases and files.
- Used 3rd generation programming languages like C++, COBOL & Java.
- Used the Data Stage Director and its run-time engine to schedule running the solution, testing and debugging its components, and monitoring the resulting executable versions (on an ad hoc or scheduled basis).
- Responsible for interacting with business partners to identify information needs and business requirements for ETL jobs.
- Created Data stage jobs (ETL Process) for populating the data into the Data Warehouse constantly from different source systems like ODS, flat files, scheduled the same using Data Stage Sequencer for System Integration testing.
- Experience in Production Support, extensively worked on production support issues.
- Extensively used BI Integration Services to design ETL process and BI Analysis Services to create cubes.
- Quick learner and adaptive to new and challenging technological environments.
- Project Management experience with excellent problem-solving, organization and leadership skills.
- Programming experience in C, C++.
- Excellent interpersonal, communication skills with a friendly positive attitude.
TECHNICAL SKILLS
Operating System: Windows 2000/XP/Vista, Unix and Linux
Databases: Teradata 13.0, Oracle 11g, SQL Server, DB2, Mainframes
Scripting languages: Shell Script, PL/SQL, SQL, C, C++, COBOL, TSO
Tools: Query man, Designer, Developer 6i; Erwin, SQL Loader; Oracle, Toad, Query Analyzer, OEM.
Warehousing Tools: IBM Information Server, IBM Information Analyzer, Data Stage 9.1/11.5/11.7
Testing Tools: Win Runner 7.0, LoadRunner7.0, Test Director 7, Rational Clear Quest, Jira
Other Tools: MSOffice, MSWord, MS Excel, MS Project.
PROFESSIONAL EXPERIENCE
Data Stage Developer
Confidential, CA
Responsibilities:
- Devising extraction, transformation and load schemes for the process
- Development of Data stage design concepts, execution, testing and deployment on the client server
- Segmentation of data according to the categories provided by the client
- Developing components and functions for data masking, encoding and decoding
- Performance tuning and resolving scratch disk memory errors
- Optimizing the search function and creating custom search patterns
- Executed Product Development Life Cycle (PDLC) process for different projects
- Developed project schedules and ETL process according to the project requirements
- Sending the data from Data stage to NDM (Network Data Mover) to Hadoop
- Created one framework in data stage with all tables
- Wrote applications testing guideline and methods
- Wrote function codes for different tasks in the database table
- Designed and developed Data stage PX ETL jobs (Parallel jobs and job sequencers)
- Developed Parallel jobs using Stages, which includes Join, Transformer, Sort, Merge, Filter and Lookup.
- Extracted merchant data from XML documents using XML input stage.
- Used Remove Duplicates stage in PX (EE) to remove duplicates in the data.
- Created job sequences. Created job schedules to automate the ETL process.
- Mapped the source and target databases by studying the specifications and analyzing the required transforms.
- Used DS Director to validate, schedule and run production jobs.
- Performed database migration and integration from the source server and prepared data mapping
- Created custom component to extract identical data from different servers of the same organization created mapping documents for the project and provided them to business
- Acted as a QA and performed regression testing for the project development
- Managing offshore teams and assigning tasks
Environment: IBM Information Server 9.1/11.5, Data stage ETL (Director, Designer, Administrator) 11.7, Hadoop Hue- 3 and 4, Oracle 11g & 12.9, Data Mapping, Unix, NDM, SQL Server 2014, Agile Development, Toad, Visio, Putty, Flat Files, SQL Scripting, Mainframes, Rally, Jira, Autosys, WinSCP, PowerBroker.
ETL Designer/Data Stage Developer
Confidential, NJ
Responsibilities:
- Designed jobs to load data into staging tables after performing required transformations depending on the business rules provided by the client.
- Worked with quality stage team to standardize and format the data.
- Deployed Data Stage jobs to different environments; development environment to test environment and from test environment to production environment.
- Worked with CICS, TSO, COBOL, VSAM, CA Easytrieve/Plus, Insync, Apptune, Endevor, DumpMaster, JCL, batch and online programming.
- Used different partitioning methods in different parallel stages to minimize the cost of the jobs.
- Extracted data from different sources like Oracle tables, SQL Server tables and flat files.
- Populated the data into Dimension Tables, Fact tables and Staging tables.
- Used multiple stages like Change Data Capture, Sequential File, Transformer, Aggregator, Join, Lookup, Sort and Filter during ETL development.
- Implemented the error handling logic to report the data errors to the Data Owners.
- Designed and used shell scripts that automate the data stage jobs and validate files.
- Worked closely with data modeler and database administrator for finalizing the data warehouse model.
- Designed shared containers for designing the reusable components in the Project.
- Used native database stages when connecting to databases which were one of our performance tuning procedures.
Environment: IBM WebSphere 8.0, Visio, Oracle 10g/9i, SQL server, UNIX, Windows XP, Toad, Mainframe’s, IBM information server 11.5/11.7
Data Stage Developer
Confidential - Detroit, MI
Responsibilities:
- Understanding the specifications for Data Warehouse ETL Processes by interacting with the client and end users for gathering business requirements.
- Designed the specifications and analyzed the data for business requirements and developed meta data mappings and detailed design documents.
- Involved in designing, developing and documenting of the ETL (Extract, Transformation and Load) strategy to populate the Data Warehouse from various source systems (Teradata) feeds using Data Stage, and Unix Shell scripts
- Used different Parallel job stages like Join, Merge, Lookup, Filter, Col and Row generator, Transformer, Modify, Aggregator, Remove Dup, Teradata Enterprise Stage, TeradataLoad Stage, TeradatamultiLoad/Tpump/Fast Export stages.
- Used Teradata utilities like Fast Load, Multi load, Pt Api Interface, BTEQ to efficiently handle data.
- Created Master sequencers using User Variable Activity, Job Activity, Execute Command Stage, Start Loop Activity, End Loop Activity, Nested Condition, Exception Handler Stages
- Used Data Stage Director and the runtime engine to schedule running the server jobs, monitoring and debugging its components.
- Worked on Data Stage admin activities like creating ODBC connections to various Data sources, Server Start up and shut down, Creating Environmental Variables, Creating Data Stage projects and Message Handler files, Dsparams File and JCL
- Design and create weekly and monthly spending reports in financial process
Environment: IBM Information Server 9.1/11.5, IBM Information Analyzer 9.1, DataStage 9.1 (Designer, Director and Administrator), Oracle 10g/11g, DB2, SQL, PL/SQL, SQL* Loader, SAP interface, Cobol flat files, UNIX Shell Script, TOAD 7.3, ERWIN 4.2, Win XP and AIX UNIX 4.2, Autosys.
Data Stage Developer
Confidential
Responsibilities:
- Analyzed, conceptualized/designed the database that serves the purpose of proving critical business metrics.
- Developed ETL procedures to ensure conformity, compliance with standards and lack of redundancy, translates business rules and functionality requirements into ETL procedures using Informatica -PowerMart.
- Worked with ERwin tool in Data Modeling (both Physical and Logical Design).
- Developed and documented data Mappings/Transformations, Audit procedures and Informatica sessions.
- Assisted in the design and Maintenance of the Metadata environment.
- Developed and tested all the backend programs, Informatica mappings and update processes.
- Effectively managed the migration of the transformations/mappings from development to Production.
- Developed various bulk load and update procedures and processes using SQL * Loader and PL/SQL.
- Managed and programmed large systems in Cobol II, VSAM, ISPF, TSO, CICS, BMS, FileAid, and JCL on an IBM mainframe
- Involved in the error checking and testing of the ETL procedures and programs of Informatica session log.
Environment: Ascential Datastage7.5 (Manager, Designer, Director, Administrator), Oracle9i, SQL, PL/SQL, SQL * Loader, UNIX, Mainframe, Cobol flat files.
Oracle Developer(Intern)
Confidential
Responsibilities:
- “IT ENABLED ACADEMIC” is based on the convenience of the students to communicate with the resources provided by the distance learning section of the university.
- It is aimed to provide services to students over Internet, each student is given with a unique id and as the student logs on into the system he will be given access to anonymous number of sections.
- It’s related to a university which is offering distance education. Its purpose is to develop a common platform to establish communication between students and university professors.
- Responsible for creating the database tables, indexes, constraints in Oracle8i.
- Played active role in tuning the oracle database queries using indexes, explain plan and optimizer hints.
- Developed packages, stored procedures, functions, triggers, views and cursors using PL/SQL.
Environment: Oracle 8i, SQL, PL/SQL, UNIX, Windows NT.
Confidential
Responsibilities:
- Provided back-end support for customized forms like customer and supplier maintenance, bill, receipt, letter of credit, invoice, debit and credit notes. Involved in configuring web.xml and struts-config.xml according to the struts framework.
- Involved in daily, weekly and Monthly load of data from Mainframe data set to Oracle database.
- Developed PL/SQL packages to monitor revenue earnings and expenses and to maintain the general ledger of the organization. Written Database objects like Triggers, Stored procedures in SQL, PL/SQL.
- Wrote database triggers for audit and data validation.
- Designed the entity-relationship model and normalized database.
Environment: Oracle 8i, SQL, PL/SQL, UNIX and Windows NT.