SMF 101 records by subsystem

Donna Domovic

SMF 101 records by subsystem

Hello,

Over the last couple of days we've seen an huge increase in SMF 101 records being generated on one of our LPARs.  We've gone from 600k/day to 15M/day.  We're drilling down and trying to determine what's causing this but it's taking a some time since we have 9 DB2 subsystems on that LPAR.

Does anyone know of a way to count the SMF 101 records by subsystem so we can more easily narrow down where the increase is coming from? 

 

We do have CA SYSVIEW for DB2, BMC APPTUNE, and MXG available but the MXG job is abending running out of sort space due to this increase.

Thanks in advance.

Donna Domovic

Dil Sasidharan

SMF 101 records by subsystem
(in response to Donna Domovic)
You should check if there are any performance traces running in any of the systems with destination SMF.

> On Mar 3, 2019, at 12:22 PM, Donna Domovic <[login to unmask email]> wrote:
>
> Hello,
>
> Over the last couple of days we've seen an huge increase in SMF 101 records being generated on one of our LPARs. We've gone from 600k/day to 15M/day. We're drilling down and trying to determine what's causing this but it's taking a some time since we have 9 DB2 subsystems on that LPAR.
>
> Does anyone know of a way to count the SMF 101 records by subsystem so we can more easily narrow down where the increase is coming from?
>
>
>
> We do have CA SYSVIEW for DB2, BMC APPTUNE, and MXG available but the MXG job is abending running out of sort space due to this increase.
>
> Thanks in advance.
>
> Donna Domovic
>
>
> Site Links: View post online View mailing list online Start new thread via email Unsubscribe from this mailing list Manage your subscription
>
> This email has been sent to: [login to unmask email]
> ESAi has well-regarded tools for Fast Cloning, Buffer Pool Tuning, Log Analysis, TDM & more.
> BCV4, BCV5, BPA4DB2, ULT4DB2... modern power tools to get the job done faster & easier than ever.
> http://www.ESAIGroup.com/idug
>
>
> Use of this email content is governed by the terms of service at:
> http://www.idug.org/p/cm/ld/fid=2
>

Charles Mills

SMF 101 records by subsystem
(in response to Dil Sasidharan)
-ssid DIS TRACharlesSent from a mobile; please excuse the brevity.
-------- Original message --------From: Dil <[login to unmask email]> Date: 3/3/19 9:27 AM (GMT-08:00) To: [login to unmask email] Subject: [DB2-L] - RE: SMF 101 records by subsystem You should check if there are any performance traces running in any of the systems with destination SMF. On Mar 3, 2019, at 12:22 PM, Donna Domovic <[login to unmask email]> wrote:Hello,
Over the last couple of days we've seen an huge increase in SMF 101 records being generated on one of our LPARs.  We've gone from 600k/day to 15M/day.  We're drilling down and trying to determine what's causing this but it's taking a some time since we have 9 DB2 subsystems on that LPAR.
Does anyone know of a way to count the SMF 101 records by subsystem so we can more easily narrow down where the increase is coming from? 
 
We do have CA SYSVIEW for DB2, BMC APPTUNE, and MXG available but the MXG job is abending running out of sort space due to this increase.
Thanks in advance.
Donna Domovic-----End Original Message-----Site Links:
View post online  
View mailing list online  
Start new thread via email  
Unsubscribe from this mailing list  
Manage your subscription  
This email has been sent to: [login to unmask email]

ESAi has well-regarded tools for Fast Cloning, Buffer Pool Tuning, Log Analysis, TDM & more.
BCV4, BCV5, BPA4DB2, ULT4DB2... modern power tools to get the job done faster & easier than ever.
http://www.ESAIGroup.com/idug

Use of this email content is governed by the terms of service at:http://www.idug.org/p/cm/ld/fid=2

Norbert Jenninger

RE: SMF 101 records by subsystem
(in response to Donna Domovic)

Donna,

from Db2 DSNWMSGS:     SMF RECORD TYPE:                                           
ACCOUNTING TRACE IS 101 (DEC) FOR IFCIDS 0003 AND 0239.   
ALL OTHER ACCOUNTING IFCIDS ARE IN SMF 102 RECORDS.       

That means, you are seeing a tremendous increase of Accounting (plan level = IFCID 3, and package = IFCID 239) records. No (other) performance trace is reported under SMF 101.

Question: How did your workload changed, respectively, did you have changed Db2 System parameter which will now report Accounting in more granularity?  (related DB2 ZPARMS setting most likely, ACCUMAC, PTASKROL, CMTSTAT, or CICS RCT definition related to accounting records cut.)

Kind regards

Norbert Jenninger

Andrew Rowley

SMF 101 records by subsystem
(in response to Donna Domovic)
This is fairly straightforward using Java with EasySMF. Here is a Java
program to count type 101 records by subsystem (assuming SM101SSI is the
field you want):

import java.io.IOException;
import java.util.HashMap;
import java.util.Map;
import com.blackhillsoftware.smf.SmfRecord;
import com.blackhillsoftware.smf.SmfRecordReader;
import com.blackhillsoftware.smf.db2.Smf101Record;

/**
 *
 * Count the number of DB2 101 records by DB2 subsystem (field SM101SSI)
 *
 */

public class Db2Smf101CountBySubsystem {

    public static void main(String[] args) throws IOException
    {
        Map<String, SubsystemInfo> subsystems = new HashMap<String,
SubsystemInfo>();

        try (SmfRecordReader reader =
                args.length == 0 ?
                SmfRecordReader.fromDD("INPUT") :
                SmfRecordReader.fromName(args[0])) {

            reader.include(101);

            for (SmfRecord r : reader) {
                Smf101Record r101 = new Smf101Record(r);
subsystems.computeIfAbsent(r101.sm101ssi(), name -> new SubsystemInfo(name))
                    .add(r101);
            }

        }
        subsystems.values().stream()
            .sorted((a, b) -> Integer.compare(b.getCount(), a.getCount()))
            .forEachOrdered(subsystem ->
                System.out.format("%-4s %8d%n", subsystem.getName(),
subsystem.getCount()));

        System.out.println("Finished");
    }

    private static class SubsystemInfo {
        private String name;
        private int count = 0;

        SubsystemInfo(String name) {
            this.name = name;
        }

        void add(Smf101Record record) {
            count++;
        }

        String getName() {
            return name;
        }

        int getCount() {
            return count;
        }
    }
}

It is not much more complicated to add additional grouping, e.g. by SSI
and IFCID, or other criteria as long as you know the fields you are
interested in.

Andrew Rowley

Black Hill Software


On 4/03/2019 4:22 am, Donna Domovic wrote:
>
> Hello,
>
> Over the last couple of days we've seen an huge increase in SMF 101
> records being generated on one of our LPARs.  We've gone from 600k/day
> to 15M/day.  We're drilling down and trying to determine what's
> causing this but it's taking a some time since we have 9 DB2
> subsystems on that LPAR.
>
> Does anyone know of a way to count the SMF 101 records by subsystem so
> we can more easily narrow down where the increase is coming from?
>
> We do have CA SYSVIEW for DB2, BMC APPTUNE, and MXG available but the
> MXG job is abending running out of sort space due to this increase.
>
> Thanks in advance.
>
> Donna Domovic
>
>
> -----End Original Message-----

Chad Walmer

SMF 101 records by subsystem
(in response to Donna Domovic)
You can use SORT to count the records by subsystem name:

//JS010 EXEC PGM=SORT,PARM='VLTESTI=1'
//SORTIN DD DISP=SHR,DSN=<your SMF data>
//SORTOUT DD SYSOUT=*
//SYSOUT DD SYSOUT=*
//SYSIN DD *
* SUM BY RECORD TYPE
INCLUDE COND=((06,1,CH,EQ,X'64'),OR, <-- TYPE 100
(06,1,CH,EQ,X'65'),OR, <-- " 101
(06,1,CH,EQ,X'66')) <-- " 102
INREC FIELDS=(00001,004, <-- RDW
00019,0004, <-- SUBSYSTEM NAME
00006,0001, <-- SMF RECORD TYPE
7Z,X'1C') <-- USED FOR SUM BELOW
SORT FIELDS=(00005,0004,CH,A,00009,0001,CH,A)
SUM FIELDS=(0010,8,PD)
OUTREC FIELDS=(1,4,5,4,9,1,BI,M0,10,8,PD,M0)


From: Donna Domovic [mailto:[login to unmask email]
Sent: Sunday, March 3, 2019 12:22 PM
To: [login to unmask email]
Subject: [DB2-L] - SMF 101 records by subsystem


Hello,

Over the last couple of days we've seen an huge increase in SMF 101 records being generated on one of our LPARs. We've gone from 600k/day to 15M/day. We're drilling down and trying to determine what's causing this but it's taking a some time since we have 9 DB2 subsystems on that LPAR.

Does anyone know of a way to count the SMF 101 records by subsystem so we can more easily narrow down where the increase is coming from?



We do have CA SYSVIEW for DB2, BMC APPTUNE, and MXG available but the MXG job is abending running out of sort space due to this increase.

Thanks in advance.

Donna Domovic

-----End Original Message-----

Donna Domovic

RE: SMF 101 records by subsystem
(in response to Chad Walmer)

Thanks to everyone who answered this.  I actually ended up using DFSORT and was able to determine the subsystem and time range where the increase started.  We're now digging into it to analyze that time range and hopefully come up with a root cause.  Initial displays didn't turn of any additional traces going to SMF or anything like that.

Thanks,

Donna Domovic