NetWorker released

NetWorker Build 753 has been released.
It can be downloaded from ftp://ftp.legato.com/pub/NetWorker/Cumulative_Hotfixes/8.2/
This package contains the following cumulative fixes:
ID Details
226673 (NW162239) ESC  Escalation 22704:Browseable recover: expand_check() function experiences massive delays after upgrade to 8.1.x from 7.x on AIX clients
225294 ESC  Escalation 22923:savepnpc commands with level skip hangs backup
225029 BUG  MMDB latency to respond to VBA savesets query, causes Restore Tab malfunction to list available backups
223984 ESC  Escalation 22756:Unable to set extended attribute ‘security.selinux’ Operation not permitted
223513 ESC  Escalation 22121:jobquery core during DPA 6.1 data collection with NetWortker
223175 (NW162157) ESC  Escalation 22649:nsrd/nsrmmdbd dead-lock during relabel
222890 (NW162215) ESC  Escalation 22688:NW:Avamar: Avamar does not delete all savesets even though nsravamar.raw shows them deleted
222833 (NW162150) ESC  Escalation 22643:[BZ: 232867] 8dot3name setting is lost after BMR using BMR_8.1.0.199 or above
206724 (NW161663) ESC  Expired cleaning tape (0 uses left) is being used for cleaning
206664 (NW162021) ESC  [MIGRATED TO BZ]Everytime a backup starts for a UNIX/Linux client, NetWorker queries LDAP for root account
204302 (NW161964) ESC  Failed recover deletes existing original file or folder on file system
199061 (NW161544) ESC  NMC is not displaying the ‘enabled/disabled’ field correctly after upgrade to
198242 (NW161619) ESC  Incosintency on used space reported on NMC, mminfo and Disk manager for AFTD device
190825 (NW154749) ESC  NetWorker server client parallelism silently changed to 12 after a restart when parallelism configured to <1
190583 ESC  snmd will not come up on slow systems owing to too short snmd poll timeout

no comments


EBR not sending summary report

This was a new one. My VMware admin dropped me a note wondering why he had not been receiving a backup summary report from NetWorker? I didn’t even know this was a configurable option? Sure enough after poking around the Web client interface I found it.

3-19-2015 4-11-53 PM



Then we found this very informative message in the log.

3-19-2015 4-15-19 PM


Some quick research found this is a known issue. It typically occurs around daylight saving time and is caused by a mismatch in time value between the summary report timer and the database. Some success had reported with rebooting the appliance.  There was some indication that editing the email option and saving without changes would rectify the issue.



no comments


New to NetWorker?


Congratulations! You have inherited some NetWorker infrastructure, either by your defined career path or by misfortune. You have a rudimentary knowledge of backup technologies, but you’re not sure where to start. This post is for you. First, head over to support.emc.com and sign up for an account. You may need to contact site support to associate your new user ID with your site id. What is your site ID? Glad you asked.

Things you should have when opening a support call

  • You should know your site ID
  • Host ID
  • NetWorker Version
  • Platform

Hopefully, somebody you work with has the site ID, if not your local sales rep might. If not contact support and have your ID associated. When associated you can open support requests online and select your site from a drop down list.

The host id is a unique ID NetWorker assigns when the software is installed. It is not to be confused with the host id of your NetWorker server or data zone.

  1. Open the NetWorker server’s NetWorker Management Console (Console) interface.
    2. Select NetWorker Administration.
    3. In the Administration interface, click the Configuration button.
    4. Right-click Registrations in the navigation tree, then right-click the NetWorker evaluation license (or any NetWorker license) in the Registrations area of the screen. The Properties window appears.
    5. In the Configuration area of the Properties window, the Host ID is the last of the parameters displayed.
    6. Click OK or Cancel to leave the Properties window.

Your version is easy enough to find. In the NMC select help and about.

With your new EMC ID you should also be able to access https://community.emc.com/. The ECN is your portal for all things EMC. Great forums, sometimes you might actually find an answer there. If you post be sure to give as much info about you infrastructure as possible, Version, platform, etc. There are some great, smart NetWorker guys that hang out there and not giving this context to your issue is a massive pet peeve.

Going back to support.emc.com. There you can find the NetWorker support portal. It’s pretty sexy. Here you can see other recommended resources. Remember, NetWorker modules have separate support pages. You can subscribe to the page and it will be saved in your product list for the future. Also I love the service life by version section as well as the shortcuts to open support tickets or live chat with EMC support.

3-18-2015 1-22-05 PM


Next check out the documentation section. Find the documentation portfolio for your NetWorker version. In there you will find the admin guide as well as a wealth of other information. One document that is worth a look if you’re new to NetWorker is “Theory of Core Operations” It may not be bundled in the portfolio, but is there if you search. The information in this guide is primarily intended to familiarize new EMC developers, test engineers, technical support engineers, product specialists, instructors, course developers, and information developers with NetWorker concepts.
This document addresses the EMC concept of “core engineering” function for the NetWorker product for Windows and UNIX operating systems.

Last but not least is http://nsrd.info/. This site is owned and administered by Preston de Guise. I’m not sure when he sleeps. He frequently post in depth content and his blog is a fantastic library of all things NetWorker. Be sure to check out his micro manuals. He has a new one called Turbo Charged NetWorker, which he intends to update regularly. He also published yearly NetWorker administrator survey results which he uses to capture trends in NetWorker uses and functions. Wow.

Also, you may pick up his book, Enterprise Systems Backup and Recovery: A Corporate Insurance Policy. A great read, I’m sure. Bought it a while ago and promise to read it one day.

So there you go. Did I miss anything? Comment below!

no comments


Backups are collaborative

This is an open letter to Windows server admins.

I have had the luxury of managing large backup environments at a few different organizations over the years. This is a great way for me to engage my skills in a very niche area as well as for my colleagues. Why for them? Well then they don’t have to manage backups as part of their daily operations. If I have learned anything since focusing in this area, it’s that nobody thinks about backups. Nobody wants to. Whether it’s in the early stages of a large system build, where we really should be brought in to consult and ensure that our backup application can ingest this new load or in daily ops. It is somehow expected that we will be there ready to drink from the veritable data fire hose and provide near zero downtime recovery.

The point I wanted to make was since the first tape drive was connected to the first mainframe, demands have required tighter integration between the backup application and your data. Whether it is a backup agent protecting your database, the vstorage API to protect your VM or VSS to capture a backup of your Windows server to ensure recoverability. They all require collaboration with backup administrators and systems administrators. Are you a Windows administrator? Are you familiar with the VSS process?  If not, you should be. Like the vstorage API and RMAN, VSS is just a mechanism that allows a backup application to capture the data. I don’t own the VSS component although I’m probably more familiar with it and better at resolving VSS issue than any Windows administrator.

If there is one thing I can assure you is this. VSS issues are not unique to any one backup product. Google “VSS backup issue” and you will find a multitude of forums from an array of products filled with angry, annoyed backup system administrators fuming over VSS.   I can generally and do fix most VSS issues without having to bother an admin. Sometimes I can’t and the only thing I can offer is to reboot the system. Is there a better solution? Yes, call Microsoft! Open a ticket, run some VSS traces. In short, work with me. Don’t treat me as a nuisance who is again requesting a reboot.

Collaborate with me because one day, you will need me by far more than I need you.

no comments


Purging Data with NetWorker and Data Domain

Purging data is sometimes required. There could be some legal requirement or more likely you are out of space on disk storage. Here is what I recently had to do.

Some data was identified to be purged. Specifically three clients.

The following tasks need to be completed:

  • Identify the save sets
  • Build the batch file
  • run nsrim -X
  • Run a clean on the DD

Identifying the save sets

There is a ton of info out there on mminfo. This is the command we will use to identify which save sets to remove. The command has two parts. A query portion where we feed in the required variables and a report portion where we can narrow the specific data we need. My command resembled the following.

mminfo -avot -q “client-clientname, volume=volumename.001” -r client,volume,ssid,cloneid

I ran the command and outputted to text. The output resembled the following.

client    volume         ssid          clone id

XXXXX volume.001 4065016450 1397439105

XXXXX volume.001 3997907656 1397439175

XXXXX  volume.001 3981130503 1397439239

XXXXX  volume.001 3947576123 1397439291

XXXXX  volume.001 3930798958 1397439341

XXXXX  volume.001 3914021948 1397439548

I’m really only concerned with the last two columns, as these are required to use with the nsrmm command to delete the data from the NetWorker databases.

The command we will use will look like this.

nsrmm-dy -S SSID/CloneID

Now that we have this we can build the batch file, as this is a windows system.

Building the batch

Just a lot of excelFU here. I saved the output from the mminfo command to a text file, then imported into using Data, From text. I selected Delimited and then selected “space” as the delimiter. This inserted my data into the columns nicely.

1 2



Next, I’ll delete everything in in columns A and B. In column A I will enter our nsrmm command as above. Then I’ll select the cell and drag it down to auto fill in the cells below.


Next I formatted all the cells as number and then entered the following formula into cell E2.

CONCATENATE(A3,” “,D3,”/”E3)

This will merge our command in column A, add a space after then our SSID and insert a / to seperate. Finally it will tag on the cloneid and output to one cell. Select the cell and drag down to auto populate. You will then have a column filled with individual commands. That entire column can be pasted into a batch file.


When complete run the batch, I have over 2000 rows so this will take while.

Run nsrim -X

nsrim -X will synchronize the media DB and wraps up the purging of this data from NetWorker

Run a clean on the DD

Start the DD clean. It can take some time, best to run when things are quiet. Here we can see we did not win a lot in the way of cleanable data?




Why is that? Reducing data retention has limited effect. When data is expired the pointers can be removed, but unique data is still needed to be retained for recovery.  Reducing retention is not always a positive thing as it can lead to a reduced pool of data to deduplicate  against. However, here we removed clients in their entirety? I can only assume that the data on this client was already highly deduplicated and there was actual precious little unique data identified. So are results are what they are. I hope yours are better. Let me know. Comment below.



no comments


What Does Total Source Capacity Mean?

Recently, when reviewing a report on a clients monthly backup statistics, an issue was highlighted with NetWorkers native licenses conformance output.




As we can see the output is not super informative. I have to admit, I was completely ignorant of exactly what Total Source Capacity meant? Now it seems self explanatory, but it took a few attempts from my SE of explaining before it sunk through the first few layers of my skull. I found this description from an EMC website that sums it up far better than I ever could.

“Data is measured as the largest aggregate full backup or synthetic full backup which is the combination of full backups plus incremental backups that are performed for all protected data by the NetWorker software over a two-month period (60 days). This is irrespective of where the data is backed up, for example, from tape, disk, VTL, Avamar ® Data Store, or Data Domain. The quantity of pre-deduplicated data is included in the calculation.”

So the measurement of total source capacity is not really directly tied to data moved or data stored, but rather the aggregate of the largest Full backup of all your protected clients over a 60 day period. My next challenge was how to determine this number? This particular client does use DPA, and I was getting ready to attempt to create a report that may pull out this information. Some googlefu found a recent question posted in the EMC community forum from a user looking for the exact same thing. After bumping some dude named Gareth came through with a deeply buried report template in DPA that would address this.



The report is called “Estimated Protected Capacity”. You can find this report under Status / Backup in the report menu. Just set you time period for 60 days and viola!


no comments


More fun with NSRADMIN


If you are responsible for maintenance and operations of some NetWorker infrastructure, you are doing yourself a huge disservice not getting to know NSRADMIN.

There is a some documentation out there, this micromanual  written by Preston over at nsrd.info is invaluable. So, lets talk about a recent use case that was of great help to me recently.

I have a large client that was migrating their VM’s into a new vCenter. Task 1. was to update the application information variable on all the client resources with the name of the new vCenter.  My friend and co-worker informed me that you can now edit multiple clients simultaneously with the NMC on NetWorker 8! I was pretty happy with this news for two reasons.

1. As previously stated, I’m not very smart. While I was sure there was going to be a way to do this with NSRADMIN I wasn’t sure how?

2. I’m also lazy and had no desire or time to figure this out.

I attempted to do this via the NMC initially. I didnt take the time to note the error, but it was something to the effect of  “Could not edit 6 of 18 selected clients…”. I kept trying with different blocks of clients and consistently had this error returned. Eventually I gave up and had more success with NSRADMIN. Here is what I did.

nsradmin> show name:; application information:
nsradmin> print type: NSR client; group: DEV4_VADP

The above returns a list of all clients in the group and the associated application information.

name: server_nameDPU101;
application information: VADP_HYPERVISOR=vdc01vmvc01.domain.com;

name: server_nameDXU101;
application information: “VADP_HYPERVISOR=vdc01vmvc03.domain.com”;


To update this variable for all the clients in the group, run the following.

nsradmin> update application information: VADP_HYPERVISOR=vsphere4.domain.com

You will be prompted to confirm for each client. I have not been able to find a way to force this. This could be scripted to make it even easier, but I was hammering this on the fly in the middle of the night and had to get this done as I wanted to go back to bed.

Lazy? Remember?



no comments


The Transformation Continues…Backup Game Day Is Back

The Transformation Continues…Backup Game Day Is Back How do you turn backup and recovery into an offensive strategy that delivers game-changing business results? More than 4,000 of you tuned in last fall to hear the first part of the story, and on Monday, March 11, we’re back with the […]

no comments


Taking VMware vSphere Storage APIs for Data Protection to the Limit: Pushing the Backup Performance Envelope

  VMworld 2012 in San Francisco has come and gone. VMworld EMEA in Barcelona is next week. It is a great event for technical audience; filled with numerous educational sessions, the largest solution pavilion and a lot of super awesome parties! VMworld issues call for papers each year. These […]

Click here to view original web page at www.symantec.com

no comments


Startup Nakivo Protects VMware Virtual Machines With Amazon Cloud Storage

Page 1 of 2 Nakivo, a startup developer of cloud storage technology, has entered the market with a cloud storage technology that takes advantage of Amazon Web Services to provide the capacity to protect VMware virtual machines and their data. Nakivo Backup & Replication provides customers and their channel […]

Click here to view original web page at www.pheedcontent.com

no comments

« Previous Entries     Next Entries »