Advanced goldengate training ⅰ

Advanced Goldengate Training Ⅰwww.oggers.net 2011-07-25

Agenda□Mothod of initialize data□ Handing essential DML and DML error□ Handing Advanced DDL sync and DDL error□ Map and manipulating data□ Monitor and TroubleshootingⅠ

Initialize Data If your database is huge and application transcations are still ongoing ,there is little stop-time,How should you Initialize your data? □ Use Keys + Handlecollsions □Use the commit SCN

Handlecollsions□How does the Handlecollsions work? □ Where is the drawbacks with Handlecollsions? ● Does your tables have any primary key or unique key?● Is there primary key update during initialization ?Suitable for your environment ?Ⅰ

Commit SCN♦ Commit SCN/GoldengateCSN♦ the common initialized mothods Via SCN□ exp/imp □ expdp/impdp□ Transport Tablespace with Backupset(compare Transport Tablespace)□ Datagurd/RMAN □ Other consistent read utilityⅠ□

How to re-initialize a special table □ split replicat group and merge it □ Using transaction CSN Filter map hr.job, target hr.job, filter (@GETENV ("transaction", "csn") > xxx);

Non-supported data types● ANYDATA● ANYDATASET● ANYTYPE● BFILE● BINARY_INTEGER● MLSLABEL● PLS_INTEGER● TIMEZONE_ABBR● TIMEZONE_REGION● URITYPE● UROWIDⅠ

DML replication action□ Keys(Primary key/unique key/keycols) action● why to recommend to use keys? ● How to use keycols?□supplemental non-key column actionⅠ

Handing DML error □ Handing replicat errors on DML operations via REPERROR Abort: roll back the transaction and stop processingDiscard: log the error to the discard file and continue processingException: send the error for exceptions processingIgnore: ignore the error and continue processing example:reperror default,discard discardfile ./dirrpt/rep_hr.dsc,append,megabytes 100Ⅰ

Use multiple REPERROR statements□ handing special error-codereperror XXXX discard□ handing special object reperror default ignore exclude/include objname “hr.jobs”Ⅰ

Use exception table REPERROR (DEFAULT, EXCEPTION)MAP hr.jobs, TARGET hr.jobs, &COLMAP (USEDEFAULTS);MAP hr.jobs, TARGET hr.jobs_exception, &EXCEPTIONSONLY, &INSERTALLRECORDS &COLMAP (USEDEFAULTS, &DML_DATE = @DATENOW(), &OPTYPE = @GETENV("LASTERR", "OPTYPE"), &ERR_NUM = @GETENV("LASTERR", "DBERRNUM"), &ERR_MSG = @GETENV("LASTERR", "DBERRMSG"));Ⅰ

DDL limitations and influence □ Disable recycle bin and affect other database environment□ affect data filtering, and manipulation by the data pump (passthru/nopassthru)□affect data-definition □OthersⅠMust configure DDL synchronization?

DDL Scope□ MappedObjects that are specified in TABLE and MAP statements □ UnmappedObjects that are not specified in TABLE and MAP statements □Other scopeDDL operations that cannot be mapped are of OTHER scope,justlike the follow operations: create user,grantrole,createtablespace ,alter datafile …Ⅰ

DDL Filter ● exclude/include ● mapped/unmapped/other/allfilter scope● opttype/objtype/objnamefilter special ddl action and object● instr/instrwors filter via matchingⅠddl &include mapped exclude objtype'table‘ objname"hr.jobs", &exclude INSTRWORDS 'alter add “city"', &include unmapped, objname "hr3.jobs", &include other

DDL DDLSUBST● When may we use DDLSUBST like as the objects on source and target have the different tablespace like as the datafile on source and tarhet have different destination ---------DDLSUBST 'users' with 'system' include mapped objtype ‘table’ INSTRWORDS 'create table tablespace "users"'Ⅰ Notice:Must be careful and the best way is to restrict the DDL statement via DDL inclusion and exclusion optionsTake care of ddl matching via instr, it’s strict matching, including space character, carriage-return character

derived object□ Notice the derived object action● Rename● CTAS● Index● Trigger□ mapderived/ nomapderivedⅠ

DDL Other Topic□ Sequencecan the sequence really be synchronized before V11.1.1.1.0?□ Password□ Add supplemental log groupsddloptionsaddtrandataretryopⅠ

Use multiple DDLERROR statements□ handing special error-codeddlerror XXXX discard□ handing special object ddlerror default ignore include OBJTYPE TABLE OBJNAME “hr1.*”Ⅰ

Agenda□Mothod of initialize data□Handing essential DML and DML error□ Handing Advanced DDL sync and DDL error□ Map and manipulating data□ Monitor and TroubleshootingⅠ

Select Rows□Method of select rows● Filterselect rows based on a numeric value by using basic operators or one or more GoldenGate column-conversion functionsMAP hr.jobs,TARGET hr.jobs, FILTER (ON INSERT, job_id > 1000); ● Whereselect rows based on a conditional statementMAP hr.jobs,TARGET hr.jobs, where (job_name=@presentand= “Jerry”);Ⅰ

Map Columns□COLMAPmap table-level column map hr.jobs, target hr.jobs_add,&colmap (usedefaults,totol_salary=salary*days); □COLMATCH map between similarly structured tables that have different column names for the same sets of datacolmatch suffix _s map hr.jobs, target hr.jobs, colmap(usedefaults);The column named Job_id on source is named Job_id_s on target Ⅰ

Data-definationsfile□data-definations fileIt’s used to synchronize source and target tables that have dissimilar data definitions● DEFGEN the tool is used to create a data-definations filedefgenparamfiledirprm/defgen.prm● SOURCEDEFS Specifies a file that contains source data definitions created by the DEFGEN utilityⅠ

Convert DML operations□ select dml type ● GETUPDATES | IGNOREUPDATES ● GETDELETES | IGNOREDELETES ● GETINSERTS | IGNOREINSERTS□ convert dml type ● INSERTALLRECORDS ● INSERTUPDATES ● INSERTDELETES● UPDATEDELETESⅠ

Obtain transaction info□ the useful of transaction info□ FunctionGETENV (“TRANSACTION”, “<return value>”)GETENV (“GGHEADER”, “<return value>”) map hr.jobs, target hr.jobs,&colmap & ( &usedefaults,&Op_type = @GETENV (“GGHEADER”, “OPTYPE”),& Indicator = @GETENV (“GGHEADER”, “BEFOREAFTERINDICATOR”), & commit_ts= @GETENV (“GGHEADER”, “COMMITTIMESTAMP”) & ) Ⅰ

Advanced goldengate training ⅰ

More Related Content

What's hot (20)

Viewers also liked (20)

Similar to Advanced goldengate training ⅰ (20)

Advanced goldengate training ⅰ