Sr. Datastage Developer Resume
Boston, MA
SUMMARY
- Over 8+ years of IT experience in Analysis, Design, Modeling, Development, Testing, Implementation and support of business applications using ETL tools and Data Warehousing applications.
- Extensive experience in Mortgage, Banking, Finance, Insurance and Telecommunications domains.
- Expertise in Data Warehousing applications DataStage 8.5/8.1/7.5 (Manager, Designer, Director and Administrator), Profile Stage, Meta Stage 6.0, Quality Stage.
- Experience in source systems analysis and data extraction from various sources like Oracle 8.x/9i/10g, DB2 UDB, MS SQL Server, Sybase, Teradata and Worked on integrating data from Flat Files, CSV files and XML files into a common reporting and analytical Data Model.
- Expertise in Parallel Extender jobs (PX Enterprises Edition) and Server Jobs.
- Involved in migration and upgrading the Data stage from lower version to higher version.
- Expertise in writing UNIX Shell Scripts, Stored Procedures, Packages, Functions, Triggers and other database objects.
- Knowledge in IBM WebSphere Information Analyzer (Infosphere) with automatically scan samples of data to determine the quality and structure it’s understand the inputs to integration process, ranging from individual fields to high - level data entities.
- Experience in logical and physical data modeling using Erwin, Dimensional Data Modeling and OLTP design.
- Proficiency in data warehousing techniques for data cleansing, Slowly Changing Dimension phenomenon, surrogate key assignment and change data capture.
- Developed batch programs in Pro*C and wrote Scripts to run on Crontab Scheduler.
- Expertise in GUI based software applications development in Windows & UNIX environments with server side PL/SQL programming.
- Involved in SQL Tuning, Optimizer, Indexes, Table partitions, and clusters.
- Expertise in Toad, SQL Navigator, Clear Case, Clear Quest, and PVCS, RCS.
- Expert in debugging, troubleshooting, monitoring, and performance tuning.
- Involved in Unit Test Case, Integration Test, User Acceptance Test (UAT) preparation and testing of the applications.
- Experience in Testing and writing SQL and Procedures.
- Strong Knowledge in dimensional Star Schema, and Snowflakes Schema methodologies to develop data marts.
- Involved in all phases of Software Development Life Cycle (SDLC).
- Good team player with excellent communication skills, Conceptual, Teamwork, Goal oriented and a Quick learner.
TECHNICAL SKILLS
ETL Tools: IBM Web Sphere/Ascential DataStage 8.5/8.1/7.5 (Manager, Designer, Director, Administrator)Quality Stage.
RDBMS: Oracle 10g/9i/8i, MS SQL Server 2000/2005, AS400, DB2 UDB, Teradata and MS Access.
Languages: C, C++, SQL and PL/SQL, Pro*C, COBOL, JCL, JAVA
Operating Systems: Sun Solaris 8, IBM AIX 5.1/4.3,UNIX LINUX and Windows 95/98/ NT/2000/ XP.
DB Utilities: SQL*Plus, SQL*Loader, TOAD 9.1, Erwin 4.1, Oracle SQL Developer, Rapid Sql.
Other S/W Tools: MS Office, Clear Case, VSS, RCS, PVCS.
Scheduling Tools: Control M, AutoSys. Tivoli.
PROFESSIONAL EXPERIENCE
Confidential, Boston, MA
Sr. DataStage Developer
Responsibilities:
- Involved in Dimensional modeling of the Data warehouse to design the business process, data representation, dimensions and fact tables using Erwin.
- Involved in designing, developing and testing of the ETL (Extract, Transformation and Load) strategy to populate the CDW data from various source systems (Flat files, XML, ORACLE, DB2 UDB).
- Extracting, cleansing, transforming, integrating and loading data into data warehouse using Datastage Designer.
- Used DataStage Manager for importing metadata from repository, new job categories and creating new data elements.
- Used DataStage Director and the runtime engine to schedule running the Parallel jobs, monitoring and debugging its components for performance and events such as error conditions.
- Extensively Database Stages-Oracle oci, ODBC stage.
- Designed and developed Server and Parallel jobs using Datastage designer to migrate data from flat files, ORACLE, DB2 UDB into the Data Warehouse.
- Developed ETL Test Plan and Test Strategies for the entire Line of businesses.
- Created routines and used them in server and parallel jobs.
- Used Parallel Extender for Parallel Processing for improving performance when extracting the data from the sources.
- Extensively Worked on Parallel Extender (PX) and Quality stage.
- Used stages like Transformer, sequential, Oracle, Aggregator, Data Set, File Set, CFF, Remove Duplicates, Sort, Join, Merge, Lookup, Funnel, Copy, Modify, Filter, Change Capture, Change Apply, Head, Tail, Sample, Surrogate Key, External Source, External Target, Real time( WebSphere MQ,XML Transformer,XML Input,XML output), Compare.
- Used After/ Before job routines to perform specific task.
- Worked with XML Transformer stage to convert and load XML data into Data Warehouse.
- Extensively worked on Error handling, cleansing of data, Creating Hash files and performing lookups for faster access of data.
- Used SQL Loader to load the data into Oracle tables.
- Created UNIX shell scripts using K-shell for calling the stored procedures for truncating the tables and calling the SQL Loader for loading the data into the target staging area and loading the stats into the stats tables.
- Worked on Autosys for scheduling and automating the month end job flow.
- Performed Unit Testing, Integration Testing and User Acceptance Testing (UAT) for every code change and enhancement.
Environment: IBM Websphere Information Server/InfoSphere DataStage 8.5/7.5, Quality Stage, Oracle10g/9i, SQL*Loader, Erwin 4.1, Clear Case, Websphere MQ 6.0, DB2 UDB, SYBASE, AIX UNIX, TOAD, Autosys, Rapid SQL 7.5.5, Windows XP.
Confidential, Boston, MA
Sr. DataStage Developer
Responsibilities:
- Involved in all phases of SDLC.
- Worked with BA to understand the Student, Course details and fee structures, Semester, Professor and financial information.
- Responsible for creating detailed design and source to target mappings.
- Responsible to communicate with business users and project management to get business requirements and translate to ETL specifications.
- Used DataStage/QualityStage Designer to import/export jobs, table definitions, Custom Routines and Custom Transformations.
- Created Extract Transform and Load (ETL) interfaces and gateways for backend database.
- Designed Mappings between sources to operational staging targets, using Star Schema, Implemented logic for Slowly Changing Dimensions (SCD).
- Extensive hand on experience on design and developing Parallel and server jobs.
- Extensively worked on building datastage jobs using various stages like Oracle Connector, Funnel, Transformer stage, Sequential file stage, LookUp, Join and Peek Stages.
- Extensively used Sort, Merge and Aggregator, Peek, DataSet and Remove Duplicates stages.
- Involved in the migration of DataStage jobs from development to QA and then to production environment.
- Created shared containers to use in multiple jobs.
- Hands on experience upgrading datastage from v7.5 to Information Server 8.1.1.
- Imported and exported Repositories across DataStage projects using datastage designer.
- Extensively worked on DataStage Job Sequencer to Schedule Jobs to run jobs in Sequence.
Environment: IBM Information Server 8.1.1 DataStage and QualityStage (Designer, Directory and Administrator), Ascential DataStage 7.5 (Manager, Designer, Director and Administrator), Oracle 11g/10g, Cognose v10.1, PL/SQL, HP-UNIX 11, Toad for Oracle.
Confidential, Owings Mills, MD
Sr. DataStage Developer
Responsibilities:
- Created Logical and Physical model of Design & Development of the star schema using dimensional modeling.
- Followed Star Schema and Snowflake Schema to develop data marts.
- Extensively used DataStage Manager for creating new job categories, metadata definitions, and data elements, import/export of projects, jobs and DataStage components, viewing and editing the contents of the repository as well as writing routines.
- Extensively used Datastage- Designer to design and develop Server and Parallel jobs to migrate data from sources like Oracle, DB2 and flat files into the Data Marts.
- Extensively used PL/SQL queries to perform operations like joins in the databases.
- Creating job sequences and schedules for automation.
- Scheduled the jobs using DataStage Director, which are controlled by DataStage engine and also for monitoring and performance statistics of each stage.
- Implemented various strategies for Slowly Changing Dimensions using DataStage Server jobs.
- Involved in Writing the SQL/PLSQL query’s for Extraction of Data.
- Developed server jobs using stages like Sequential file, Hash file, Transformer, Sort, Aggregator etc from heterogeneous systems to Oracle.
Environment: Ascential DataStage7.5, Oracle 9i, UNIX, Erwin 4.0, DB2 UDB, HP Quality Center 8.0, ClearCase, TOAD, Windows XP.
Confidential, Columbus, OH
Sr. DataStage Developer
Responsibilities:
- Designed and developed DataStage jobs for data extraction from different data feeds into Enterprise Data warehouse as part of INSIGHT project which includes brands Victoria's Secret, Pink, Bath & Body Works, Henri Bendel, C. O. Bigelow, The White Barn Candle Company and La Senza.
- Involved in functional and technical meetings and responsible for creating ETL Source - to - Target maps.
- Co-ordinate with Business users to understand the business needs, metric and reports in Retail Industry.
- Extensively worked on bring store, location, distribution center, SKU Flow planning, merchandise planning data into EDW.
- Extensively worked on bringing Manugistics, Planogram, Inventory, and Space Planning application data from Oracle into EDW (Teradata).
- Worked on Slowly Changing Dimension (SCD) stage.
- Worked on new data type ‘LOB’ to successfully bring customer online reviews on VSD and PINK brands.
- Using Multi Client Manager worked on IBM DataStage 7.5.2 and IBM InfoSphere 8.0.1.
- Extensively worked on EASI (Enterprise Stores Integration system) on Oracle data processing into EDW.
- Designed and developed DataStage jobs to process ADS (Alliance Data Systems) inbound XML feed into EDW. ADS is a 3rd party vendor who takes care of credit / Store cards.
- Extensively worked on XML Plug-In to process real time files and to reach out web services (RTI).
- Processed Sales Projection and product merging files from Hyperion system.
- Worked on processing Sales data into EDW and aggregating sales data to TD (Transaction Day) and PD (Post Date).
- Developed various DataStage jobs using Teradata Enterprise Stage, TDMLoad, Oracle Enterprise Stage, Sequential file, and XML Input and XML Transformer stages.
- Extracted SAP data into Preserve area (Flat files) and Loaded preserve data into Enterprise Data Warehouse on Teradata after applying business rules.
- Extensively worked on SAP Extract PACK (SAP R3 Plug-in), which enables Ascential DataStage to communicate with SAP source systems.
- Involved extracting data from SAP Material Management (MM), Sales & Distribution (SD), and C-Projects modules.
- Extensively worked on extracting SAP Retail data into EDW using FTP and C-PIC data transfer methods.
- Good understanding on SAP Intermediate Docs (IDoc) and BAPI concepts.
- Imported metadata from Teradata schemas using DataStage Manager.
- Worked on building UNIX Shell scripts to handle and validate the inbound files.
- Involved in migration process from DEV to Test and then to PRD.
- Created and used template jobs sequence to generate Header and Footer for each and every interface file across the enterprise.
Environment: Ascential Data Stage EE 7.5.1A, Ascential MetaStage 7.5.x, SAP NetWeaver™ 04, SAP BW 3.5.1, Ascential™ PACK for SAP R/3 V. 5.1, Ascential™ PACK for SAP BW V. 4.1, Teradata V2R6 / V2, R12, Oracle 9i, SQL Server 08.00.63239 , Control-M, Windows XP,ClearCase, IBM DB2 9.1, AIX 5.3
Confidential
Oracle Developer
Responsibilities:
- Wrote stored procedures & Triggers in PL / SQL.
- Interacted with users to understand & analysis the user requirements.
- Create/modify several UNIX shell scripts for loading data files.
- Interacted with the team leader on the requirements and analysis.
- Developed Pro*C with embedded SQL scripts for manipulation in Oracle Database.
- Developed a transaction processor in Pro*C and SQL to validate and store all requests in Oracle Database.
- Generated reports in Pro*C.
- Participated in strategizing & implementing database security plans.
- Loaded the data from / to the tables by kicking off SQL * Loads scripts.
- Worked with the testing team in fixing bugs for the system, unit testing, running the test cycles, system integration.
Environment: Oracle 7.3, Pro*C, C, UNIX, LINUX, Oracle Forms6i, Windows NT, TOAD.