Home › Knowledgebase › KB-1488

Storage And Archiving Strategies For Large Legal Discovery Datasets

Summary

This guide helps you troubleshoot and resolve: Storage And Archiving Strategies For Large Legal Discovery Datasets. Follow the steps below to fix the issue.

Quick Tip: Need immediate assistance? 💻 Open a Ticket

Common Causes

Storage And Archiving Strategies For Large Legal Discovery Datasets

Electronic discovery (eDiscovery) involves managing vast quantities of emails, documents, and digital records. For Australian legal practices, maintaining the integrity, security, and accessibility of these datasets is critical for case preparation and compliance with Australian legal discovery obligations. This guide outlines effective storage and archiving strategies specifically for law firms handling large eDiscovery datasets.

eDiscovery Storage Requirements For Legal Practices

Before selecting a storage solution, analyse the volume and sensitivity of your discovery data. Australian legal practices must consider:

Secure Storage Options

On-Premises Network Attached Storage (NAS)

NAS devices provide local control over data and can be configured with RAID for redundancy. This is suitable for firms that prefer to keep sensitive legal data within their own office infrastructure. Configure your NAS with the following settings:

  1. Open your NAS administration interface.
  2. Go to Storage Manager > RAID Management > Create RAID 1 or RAID 5 volume.
  3. Go to Control Panel > Privilege > Shared Folders > Edit > Encryption > Enable AES-256 encryption.
  4. Go to Control Panel > Privilege > Users > Create user accounts for each legal practitioner and paralegal.

Cloud Storage

Cloud solutions offer scalability and remote access. Ensure your provider offers encryption at rest and in transit, and that data is stored in Australian data centres to meet data sovereignty requirements.

  1. Log into your cloud storage console.
  2. Go to Settings > Data Residency > Select Australia (Sydney or Melbourne region).
  3. Go to Security > Encryption > Enable encryption at rest and in transit.
  4. Go to Access Control > Add users by email address and assign read-only or contributor permissions.

Legal Hold Procedures

A legal hold (also known as a litigation hold) suspends normal deletion and retention policies when litigation is reasonably anticipated. Implementing a defensible legal hold is essential for Australian legal practices to avoid spoliation sanctions.

  1. Issue a written legal hold notice to all custodians identifying the matter, relevant date ranges, and data types to be preserved.
  2. In your backup software, go to Settings > Retention > Create Policy > Name: "Legal Hold - [Matter Number]" > Retention: Indefinite > Save.
  3. Apply the legal hold policy to the custodian's mailbox, file shares, and cloud storage accounts.
  4. Document the date the hold was issued, the custodians notified, and the systems affected in your matter management system.
  5. Send periodic reminders to custodians to preserve relevant data and avoid deletion.
  6. Release the legal hold only when the matter is concluded and all appeal periods have expired, documenting the release date and authorising partner.

Important: Do not rely on standard retention policies during an active legal hold. Legal hold policies override normal deletion schedules.

Chain Of Custody Documentation

Chain of custody records the chronological history of evidence collection, transfer, analysis, and storage. Maintain detailed logs to demonstrate that discovery data has not been altered.

  1. Create a chain of custody form for each dataset capturing: matter number, custodian name, date and time of collection, person collecting the data, source device or system, and hash value (MD5 or SHA-256).
  2. Generate a hash value for each file or dataset at the point of collection using a tool such as File Checksum Integrity Verifier (FCIV) or PowerShell: Get-FileHash -Path "C:\Discovery\Evidence.docx" -Algorithm SHA256.
  3. Store the hash value and chain of custody form in a read-only evidence folder.
  4. Log every access, transfer, or export of the data, including date, time, user, and purpose.
  5. Store chain of custody logs separately from the discovery data to prevent tampering.

Metadata Preservation

Metadata (such as creation date, modification date, author, and email headers) is often as important as the document content itself. Preserve native metadata throughout the eDiscovery process.

  1. Avoid opening, editing, or saving native files directly from discovery sources, as this can alter metadata.
  2. Work from forensic copies or read-only mounts of the source data.
  3. When exporting from email systems, use PST or MSG formats to preserve email headers and attachment structures.
  4. Document any metadata fields that are critical to your matter, such as sent/received dates, author, and last modified date.
  5. Verify metadata integrity after any transfer by comparing file properties before and after migration.

Native File Production And Imaged Formats

Understand the difference between native file production and imaged production (such as PDF or TIFF). Australian courts and opposing parties may require native files to preserve metadata and functionality.

  1. Identify whether the opposing party or court requires native files, imaged files, or both.
  2. For native production, provide files in their original format (for example, .docx, .xlsx, .pst, .msg) with associated metadata load files.
  3. For imaged production, convert documents to PDF or TIFF with Bates numbering using eDiscovery software.
  4. Create a production set containing the produced files, load file, and index.
  5. Perform quality control checks on a sample of produced files to verify metadata and page counts.

Implementing Retention Policies

Establish clear retention policies to determine how long discovery data must be kept. These policies should align with legal requirements, court rules, and internal firm guidelines.

  1. Identify the statutory retention period for different types of legal records under Australian law.
  2. In your backup software, go to Settings > Retention > Create Policy > Name: "Discovery - Civil Matters" > Retention: 7 years after case closure > Save.
  3. Create a schedule for reviewing and disposing of data that has reached the end of its retention period.
  4. Document the policy and ensure all staff are trained on the correct handling of discovery materials.

Note: Regularly audit your storage to ensure that obsolete data is securely deleted once the retention period has expired, unless a legal hold is in place.

Defensible Deletion Procedures

Defensible deletion ensures that data is destroyed only after retention periods expire and no legal hold applies. Undisciplined deletion can expose your firm to sanctions and reputational damage.

  1. Generate a report of all discovery datasets approaching their retention expiry date.
  2. Cross-reference each dataset against active legal holds and pending matters.
  3. Obtain written authorisation from the responsible partner before deletion.
  4. Use secure deletion methods that overwrite data, such as your backup software's secure erase function or a certified data destruction service.
  5. Record the deletion in your retention log, including matter number, date range, method, and authorising partner.

Archiving Strategies

Archiving moves inactive data to a lower-cost storage tier while keeping it accessible for future reference. This reduces the load on primary storage systems.

  1. Identify closed cases and move their associated datasets to archive storage.
  2. Compress files where appropriate to save space, using standard formats such as .zip or .7z.
  3. Apply metadata tags to archived folders for easy retrieval using case names or matter numbers.
  4. Schedule periodic integrity checks to ensure archived files have not become corrupted.

Warning: Never store the only copy of critical discovery data on a single device. Always maintain at least one secure backup.

Access Control And Confidentiality

Restrict access to discovery datasets based on role and necessity. Use folder permissions to ensure that only authorised personnel can view or modify sensitive files.

For assistance with implementing these strategies or configuring secure storage for your legal practice, Open a Ticket.

Still Having Issues?

Need more help? If the issue persists after trying these steps, please open a support ticket and our team will assist you.

💻 Open a Ticket