DB2 Z/OS (Mainframe) Change data capture Log Reader/Extractor

Dip Saha

DB2 Z/OS (Mainframe) Change data capture Log Reader/Extractor

Hi Folks,

I am looking for DB2 Z/OS (Mainframe) Change data capture solution for Log Reader/Extractor. Do you know any API's that can be used to read the transaction logs and which returns the result in readable table/file format. e.g.db2readLog() for DB2 LUW ,Logminer for Oracle database.

Thanks

Dipankar

 

Ruediger Kurtz

AW: DB2 Z/OS (Mainframe) Change data capture Log Reader/Extractor
(in response to Dip Saha)
Dipankar,

BMC’s Logmaster comes to mind, you might want to contact a friendly BMC salesman.

best regards


Rüdiger Kurtz
Abteilung Informatik – Betrieb

HUK-COBURG
Bahnhofsplatz
96444 Coburg
Telefon: 09561 96-44148
Telefax: 09561 96-44104
E-Mail: [login to unmask email]
Internet: www.huk.de
________________________________
HUK-COBURG Haftpflicht-Unterstützungs-Kasse kraftfahrender Beamter Deutschlands a. G. in Coburg
Reg.-Gericht Coburg HRB 100; St.-Nr. 9212/101/00021
Sitz der Gesellschaft: Bahnhofsplatz, 96444 Coburg
Vorsitzender des Aufsichtsrats: Prof. Dr. Heinrich R. Schradin.
Vorstand: Dr. Wolfgang Weiler (Sprecher), Stefan Gronbach, Klaus-Jürgen Heitmann, Dr. Hans Olav Herøy, Sarah Rössler, Daniel Thomas (stv.).
________________________________
Diese Nachricht enthält vertrauliche und/oder rechtlich geschützte Informationen.
Wenn Sie nicht der richtige Adressat sind oder diese Nachricht irrtümlich erhalten haben,
informieren Sie bitte sofort den Absender und vernichten Sie diese Nachricht.
Das unerlaubte Kopieren sowie die unbefugte Weitergabe dieser Nachricht ist nicht gestattet.

This information may contain confidential and/or privileged information.
If you are not the intended recipient (or have received this information in error) please notify the
sender immediately and destroy this information.
Any unauthorized copying, disclosure or distribution of the material in this information is strictly forbidden.
________________________________
Von: Dip Saha [mailto:[login to unmask email]
Gesendet: Montag, 15. Mai 2017 07:51
An: [login to unmask email]
Betreff: [DB2-L] - DB2 Z/OS (Mainframe) Change data capture Log Reader/Extractor


Hi Folks,

I am looking for DB2 Z/OS (Mainframe) Change data capture solution for Log Reader/Extractor. Do you know any API's that can be used to read the transaction logs and which returns the result in readable table/file format. e.g.db2readLog() for DB2 LUW ,Logminer for Oracle database.

Thanks

Dipankar



-----End Original Message-----

James Campbell

DB2 Z/OS (Mainframe) Change data capture Log Reader/Extractor
(in response to Dip Saha)
There is an IFCID that will give you the log records. But because everyone (well, most
sites) use compression, you need to read the compression dictionary records to be able to
understand what the log records mean. Nothing to stop you writing your own code to do
that.

BMC, CA and IBM have products in this space. Not free, but they work, are supported (for
when they don't), etc.

James Campbell

On 14 May 2017 at 22:51, Dip Saha wrote:

>
> Hi Folks,
> I am looking for DB2 Z/OS (Mainframe) Change data capture solution for Log Reader/Extractor.
> Do you know any API's that can be used to read the transaction logs and which returns the result
> in readable table/file format. e.g.db2readLog() for DB2 LUW  ,Logminer for Oracle database.
> Thanks
> Dipankar
>  
>

Jorg Lueke

RE: DB2 Z/OS (Mainframe) Change data capture Log Reader/Extractor
(in response to Dip Saha)

There are quite a few log readers that can move data around for you, you'll have to investigate which ones meet your specific needs or can be adapted for them. Informatica Power Exchange, IBM CDC, Sybase data replication (not sure if they still sell being owned by Oracle), SQData, Oracle Golden Gate are all solutions I support or have supported in the past for data replication from DB2 z. The Log Analyzer tools also have replay functions to generate transactions or redo sql but I'm not sure that would fit what you want.

Javier Estrada

RE: DB2 Z/OS (Mainframe) Change data capture Log Reader/Extractor
(in response to Jorg Lueke)

Hi:

  CA Log Analyzer can give you the redo content from the logs as standard insert/delete/update operations that you can then transmit and execute anywhere you want. The tricky part is whether you handle identity columns in the source and how you want them to be replicated (if you use GENERATED ALWAYS, your inserts will not have that value, but if your applications work with columns as GENERATED BY DEFAULT and they actually insert the value, then you'll also see the value on the redo report).

 

Regards,

Javier Estrada Benavides,

IBM Certified DB2 11 for z/OS System Administrator, Mexico.

Rob Barbour

DB2 Z/OS (Mainframe) Change data capture Log Reader/Extractor
(in response to Dip Saha)
Hi Dipankar,

You can use log tools such as ULT4DB2
http://www.esaigroup.com/doc/DB2Overview.pdf for this. There are also
log analysis tools from CA, BMC, IBM.

Thanks,
Rob


On 5/15/2017 1:51 AM, Dip Saha wrote:
>
> Hi Folks,
>
> I am looking for DB2 Z/OS (Mainframe) Change data capture solution for
> Log Reader/Extractor. Do you know any API's that can be used to read
> the transaction logs and which returns the result in readable
> table/file format. e.g.db2readLog() for DB2 LUW ,Logminer for Oracle
> database.
>
> Thanks
>
> Dipankar
>
>
> -----End Original Message-----

--
Signature Best Regards,
Rob Barbour
Enterprise Systems Associates, Inc ("ESAi")
UCF Research Park
3259 Progress Drive
Orlando, Florida 32826 USA
Toll Free: 1-866-GO-4-ESAI (1-866-464-3724)
http://www.ESAIGroup.com/products
http://www.ESAIGroup.com/products
Thanks to those who visited us at
IDUG 2017 DB2 Tech Conference in Anaheim


twitter.com/ESAiSoftware http://www.twitter.com/ESAiSoftware


z Performance... Productivity for DB2... Services...
BCV4 - DB2, SAP, PeopleSoft Clones/Refreshes in Minutes vs Days
BCV5/BCV6 - Save 90% in CPU & Clock Time for DB2 Refresh / Migrate
XDM - Test Data Mgmt & Masking for DB2,Oracle, SQL Server et.al.
ULT4DB2 - Faster, Better Value in DB2 Log Analyzers w/ PROP, & Audit
BPA4DB2 - Save $, Improve DB2 Performance with Buffer Pool Analyzer
XM4DB2 - Proactive Approach for DB2,Performance, & Dynamic SQL
SQLQC - Find, Analyze, Improve SQL Quality Control and Performance

zDYNACAP - Meet SLAs at Lowest MLC Cost with Capacity Balancing
INSPECT-CPU - Improve CICS Application Performance with ICPU





Dip Saha

RE: DB2 Z/OS (Mainframe) Change data capture Log Reader/Extractor
(in response to James Campbell)

Thanks Guys for your reply.

James,

I am looking for custom build solution, as unfortunately we did not have good experiences with chosen product tool.

After doing some research I found that there are few options -

- IBM IFI (Instrumentation Facility Interface) API IFCID 306 for extraction

- Using DSN1LOGP utility which outputs in hexadecimal format.

Would be awesome, if you could elaborate or send me some links/papers for IFCID for CDC.

Thanks,

Dip

Phil Grainger

DB2 Z/OS (Mainframe) Change data capture Log Reader/Extractor
(in response to Dip Saha)
Creating your own log analysis tool instead of buying one is likely not a good long term solution

The DB2 log is not a simple place to be

And I speak from experience!

Phil Grainger
BMC Software

Sent from my iPhone

On 15 May 2017, at 19:04, Dip Saha <[login to unmask email]<mailto:[login to unmask email]>> wrote:


Thanks Guys for your reply.

James,

I am looking for custom build solution, as unfortunately we did not have good experiences with chosen product tool.

After doing some research I found that there are few options -

- IBM IFI (Instrumentation Facility Interface) API IFCID 306 for extraction

- Using DSN1LOGP utility which outputs in hexadecimal format.

Would be awesome, if you could elaborate or send me some links/papers for IFCID for CDC.

Thanks,

Dip

-----End Original Message-----
BMC Software Limited Registered Office: Building E2, Eskdale Road, Winnersh, Wokingham, Berkshire, United Kingdom, RG41 5TS Registered in England No. 1927903 The content of this email is confidential. If you are not the addressee, you may not distribute, copy or disclose any part of it. If you receive this message in error, please delete this from your system and notify the sender immediately.

Venkat Srinivasan

RE: DB2 Z/OS (Mainframe) Change data capture Log Reader/Extractor
(in response to Dip Saha)

DB2 facilitates reading log records with a data capture exit or using IFI interface. The exit route is fairly complicated and is in critical path. With IFI you can either access IFCID 129 for ci or 306 which is somewhat easier but quite a challenge to do in house. Hence most customers rely on third party tools. Performance and tuning guide has a chapter on IFI usage. You will use IFI READS (sync read) to chase the log records since last captured rba. With 306 you can request that db2 decompress the data for you. The data will be in internal format especially numeric fields.

You can also access log dataset with a standalone interface DSNJSLR. DSN1LOGP itself uses DSNJSLR. You will have to know quite a bit of internals to do this.

The easiest route is to read up on ifcid 306, how to setup the WQAL area for 306 and invoke using READS. Your infrastructure team will consider it beyond what a typical programmer is allowed to do.

Venkat  

In Reply to Dip Saha:

Thanks Guys for your reply.

James,

I am looking for custom build solution, as unfortunately we did not have good experiences with chosen product tool.

After doing some research I found that there are few options -

- IBM IFI (Instrumentation Facility Interface) API IFCID 306 for extraction

- Using DSN1LOGP utility which outputs in hexadecimal format.

Would be awesome, if you could elaborate or send me some links/papers for IFCID for CDC.

Thanks,

Dip

Jim Tonchick

DB2 Z/OS (Mainframe) Change data capture Log Reader/Extractor
(in response to Phil Grainger)
I agree with Phil. Answer this question, when a PTF changes how a log record is formatted, do you want that call at 4AM?
<span style="font-size: 16px;">
</span>
<span style="font-size: 16px;">Unless this process will have a very a short life span, it's best to pony up the $$ for a vendor supported product that will do the job. They are business partners with IBM and get early notice on changes in DB2 design that impacts log record formats. Your home-grown log reader won't. Believe me, I've made those mistakes in the past and had to live with the support consequences. Pay the $$ for a supported product and you get to be the one making the 4AM call instead of receiving it.
</span>

-----Original Message-----
From: Grainger, Phil <[login to unmask email]>
To: db2-l <[login to unmask email]>
Sent: Mon, May 15, 2017 02:22 PM
Subject: [DB2-L] - RE: DB2 Z/OS (Mainframe) Change data capture Log Reader/Extractor



<div id="AOLMsgPart_2_ba3fbbb2-1893-4e49-90ee-af972b118f8f">
<div dir="auto" class="aolReplacedBody">
<div>Creating your own log analysis tool instead of buying one is likely not a good long term solution
<div id="aolmail_AppleMailSignature">

</div>
<div id="aolmail_AppleMailSignature">The DB2 log is not a simple place to be</div>
<div id="aolmail_AppleMailSignature">

</div>
<div id="aolmail_AppleMailSignature">And I speak from experience!</div>
<div id="aolmail_AppleMailSignature">

</div>
<div id="aolmail_AppleMailSignature">Phil Grainger</div>
<div id="aolmail_AppleMailSignature">BMC Software



Sent from my iPhone</div>



On 15 May 2017, at 19:04, Dip Saha <<a target="_blank" rel="noopener noreferrer" href="mailto:[login to unmask email]">[login to unmask email]</a>> wrote:




<blockquote>


<p>Thanks Guys for your reply.</p>
<p>James,</p>
<p>I am looking for custom build solution, as unfortunately we did not have good experiences with chosen product tool.</p>
<p><span>After doing some research I found that there are few options -</span></p>
<p><span>- IBM IFI </span><span>(</span><span>Instrumentation Facility Interface) </span><span>API IFCID 306 for extraction</span></p>
<p><span>- Using DSN1LOGP utility which outputs in hexadecimal format.</span></p>
<p><span>Would be awesome, if you could elaborate or send me some links/papers for IFCID for CDC.</span></p>
<p><span>Thanks,</span></p>
<p>Dip</p>


<div align="left">-----End Original Message-----
</div>
</blockquote>
BMC Software Limited Registered Office: Building E2, Eskdale Road, Winnersh, Wokingham, Berkshire, United Kingdom, RG41 5TS Registered in England No. 1927903 The content of this email is confidential. If you are not the addressee, you may not distribute, copy
or disclose any part of it. If you receive this message in error, please delete this from your system and notify the sender immediately.

<hr size="1" style="color:#ccc"><div id="aolmail_socfooter" style="font-size:80%"><span style="font-weight:bold">Site Links: </span>
<a target="_blank" rel="noopener noreferrer" href="http://www.idug.org/p/fo/st/?post=181232&anc=p181232#p181232">View post online</a>
<a target="_blank" rel="noopener noreferrer" href="http://www.idug.org/p/fo/si/?topic=19">View mailing list online</a>
<a target="_blank" rel="noopener noreferrer" href="mailto:[login to unmask email]">Start new thread via email</a>
<a target="_blank" rel="noopener noreferrer" href="mailto:[login to unmask email]?Subject=Unsubscribe">Unsubscribe from this mailing list</a>
<a target="_blank" rel="noopener noreferrer" href="http://www.idug.org/p/us/to/">Manage your subscription</a>


This email has been sent to: <a href="mailto:[login to unmask email]">[login to unmask email]</a>
<p>
Learn how ESAi's fast data refresh & Test Data Management products can save up to 90% in CPU, I/O

and manual efforts compared to typical solutions. Be a hero to your users with BCV5 & XDM. See

<a target="_blank" rel="noopener noreferrer" href="about:blank">ttp://www.ESAIGroup.com/idug </a>

</p>
<p>
Use of this email content is governed by the terms of service at:
<a target="_blank" rel="noopener noreferrer" href="http://www.idug.org/p/cm/ld/fid=2">http://www.idug.org/p/cm/ld/fid=2</a></p>

</div><hr size="1" style="color:#ccc">

</div>
</div>
</div>