Mitigating Risks of the IT Disaster Recovery Test

The IT Disaster Recovery Test as part of the Business Continuity testing is becoming an annual event for most IT departments. It is mandated by a lot of regulators, nearly insisted upon by internal audit and ofcourse a very healthy thing to do.

But performing the IT DRP test without proper risk management can put your organization at significant risk.


To put things into perspective, let's analyze the steps, risks and countermeasures of an IT Disaster Recovery test:


DRP Test StepActivityRisksCountermeasures
1. Failure of primary systemsIn order to perform a disaster situation, the Primary systems need to be caused to fail on some level
  1. Databases not closed properly/damaged due to forced shutdown or forced power failure
  2. Hardware components failing due to forced shutdown or power failure
  3. Spilt-brain cluster due to uncontrolled sequence of failures of servers and storage
  1. Full backup prior to the initiation of the DRP test
  2. Backup components and Vendor presence at ready during the entire test.
  3. Not performing a direct forced shutdown but forcing a network level isolation at the routers
2. Activation of Disaster Recovery systemsSevering any relation between the DR and the primary systems and running the DR systems as temporary primary
  1. Actual failure of primary system during the test
  2. Failure of the primary system while the DR system is concluded to be non-functional
  1. Full awareness of the test of every interested party - business custodians, directors of divisions and top management to initiate the real Business Continuity Plan
  2. Full backup prior to the initiation of the DRP test at DRP site, and full vendor support.
3. Reconfiguring the user environmentIntervening in the end-user environment in a way that will make them use the DR system
  1. Error in reconfiguration which may cause the end-user to input test data into the primary systems
  2. Error in reconfiguration which may cause the primary system to stop functioning.
  1. , 2. Scripted and documented steps of reconfiguration. All steps should be performed by 2 persons - one observing the others actions
4. Reverting to the primary systemsResuming the primary systems at some level and reestablishing the relation between the DR and the primary systems
  1. Error in reconfiguration which may cause the primary system to stop functioning.
  2. Copying of test data that was input into the DR test system back into the primary location3. Failure of primary systems during resumption
  1. Scripted and documented steps of reconfiguration. All steps should be performed by 2 persons - one observing the others actions.
  2. Fully controlled and documented process of resumption, which guarantees that only the primary system is data master.
  3. Full backup prior to the initiation of the DRP test, Backup components and Vendor presence at ready during the entire test.



With all these risks, is it more prudent to never perform an IT DRP test? - Absolutely NOT, and here is why:
  • Performing the IT DRP test actually confirms that things are running, and if something breaks, you are much more prepared for the next time.
  • Not performing the test will just make you think everything is great, until the incident occurs. And the incident is just as certain as death and taxes
So, perform the IT DRP test regularly, but with a whole set of countermeasures for the possible risks which can happen during the test. Of course you will miss some risks, but if you plan for 10 and miss 1 is much better then not planning at all!

Talkback and comments are most welcome

Related posts
iPhone Failed - Disaster Recovery Practical Insight
Business Continuity Analysis - Communication During Power Failure
Business Continuity Plan for Brick & Mortar Businesses
Example Business Continuity Plan For Online Business

25 comments:

Jason said...

Great post, very funny. I feel your pain of backups and DR.

just an fyi, have you looked at moving your comments to another provider? Disqus works with blogger. I'm just not much of a fan of bloggers comment system :)

Bozidar Spirovski said...

I write this post because nobody needs to feel such pain.

yuvikhan said...

good a web site to a selection of paid out for buffering exodus for kodi Tuning in to music is certainly generally a in addition to on nice.

ershovayuli said...

good credit and start off showing your data with lightning swiftness. open SHAREit, which is certainly one of the virtually SHAREit on Windows Download nice.

Ahmed Mahmoud said...

Thanks, for this helpful security info
kodi latest version

Anonymous said...

Thanks, i really like this post
how to use kodi on pc

robertgreene said...

good Playing all android games on pc could be possible. official website Merely like Bluestacks, Droid 4X is definitely likewise great.

Mark Collins said...

IMO Video Call
Mortal Kombat Annihilation Full Movie
How To Get Clash Of Clans On PC
SHAREit

gleason ricardo said...

good your favourite and latest pictures in this event it is possible to download Showbox Download can readily download from the world. So we're writing this post to direct nice.

Getit said...

Lovely blog it is. Download Zapya for PC to share files and folders easily from PC to Mobile

audreybphillips said...

good Install the Downloaded Pokemon GO https://tutuappguide.com You might be pretty well acquainted with PokemonGoAnywhere. nice.

audreybphillips said...

Great so we need to mount the Android application Snapchat Login If you desire help in the process, after Fine.

cathrynzbrown said...

good professional pack purchased and opened variation and Mini Militia Mod in-game email web link. In the Pro Player Load to get full nice.

Sunmugam Chidambaram said...


Good post like to Read More Like this
xender for pc

Anonymous said...

very goood and great news for helping me so get more abou the life time info in below links veryu usefull every time

how to connect xbox one controller


samsung milk music

sidesync


turn off flashlight

smart switch mobile samsung


how to take a screenshot on a samsung

pradip patel said...

here best and free install aptoide for iphone for free all time.

pradip patel said...

best apk for download aptoide free install and download any time

pradip patel said...

best apk for Aptoide Apk free install and download

pradip patel said...

best 3ds emulator games and now play easy and well

pradip patel said...

sb game hacker free and install for this apk

pradip patel said...


now this all part of this gear manager all part of samsung gear manager all time

pradip patel said...

now you best thing to read for enable imessage for your best knowlage that is best for all time

pradip patel said...

pair xbox one controller is best all time and Here best list of Speedometer App for fitness tracker for all android device

pradip patel said...


best 3ds emulator games and now play easy and well

pradip patel said...

best no wifi games in this list for best free games without wifi

Designed by Posicionamiento Web