Storage And Archiving Strategies For Large Legal Discovery Datasets
Summary
This guide helps you troubleshoot and resolve: Storage And Archiving Strategies For Large Legal Discovery Datasets. Follow the steps below to fix the issue.
Common Causes
Storage And Archiving Strategies For Large Legal Discovery Datasets
Electronic discovery (eDiscovery) involves managing vast quantities of emails, documents, and digital records. For Australian legal practices, maintaining the integrity, security, and accessibility of these datasets is critical for case preparation and compliance with Australian legal discovery obligations. This guide outlines effective storage and archiving strategies specifically for law firms handling large eDiscovery datasets.
eDiscovery Storage Requirements For Legal Practices
Before selecting a storage solution, analyse the volume and sensitivity of your discovery data. Australian legal practices must consider:
- Total data size (terabytes versus gigabytes)
- Required retention periods based on legal obligations and court rules
- Access frequency for active matters versus closed cases
- Confidentiality and privacy requirements under Australian law, including the Privacy Act 1988
- Metadata preservation requirements for evidentiary integrity
Secure Storage Options
On-Premises Network Attached Storage (NAS)
NAS devices provide local control over data and can be configured with RAID for redundancy. This is suitable for firms that prefer to keep sensitive legal data within their own office infrastructure. Configure your NAS with the following settings:
- Open your NAS administration interface.
- Go to Storage Manager > RAID Management > Create RAID 1 or RAID 5 volume.
- Go to Control Panel > Privilege > Shared Folders > Edit > Encryption > Enable AES-256 encryption.
- Go to Control Panel > Privilege > Users > Create user accounts for each legal practitioner and paralegal.
Cloud Storage
Cloud solutions offer scalability and remote access. Ensure your provider offers encryption at rest and in transit, and that data is stored in Australian data centres to meet data sovereignty requirements.
- Log into your cloud storage console.
- Go to Settings > Data Residency > Select Australia (Sydney or Melbourne region).
- Go to Security > Encryption > Enable encryption at rest and in transit.
- Go to Access Control > Add users by email address and assign read-only or contributor permissions.
Legal Hold Procedures
A legal hold (also known as a litigation hold) suspends normal deletion and retention policies when litigation is reasonably anticipated. Implementing a defensible legal hold is essential for Australian legal practices to avoid spoliation sanctions.
- Issue a written legal hold notice to all custodians identifying the matter, relevant date ranges, and data types to be preserved.
- In your backup software, go to Settings > Retention > Create Policy > Name: "Legal Hold - [Matter Number]" > Retention: Indefinite > Save.
- Apply the legal hold policy to the custodian's mailbox, file shares, and cloud storage accounts.
- Document the date the hold was issued, the custodians notified, and the systems affected in your matter management system.
- Send periodic reminders to custodians to preserve relevant data and avoid deletion.
- Release the legal hold only when the matter is concluded and all appeal periods have expired, documenting the release date and authorising partner.
Important: Do not rely on standard retention policies during an active legal hold. Legal hold policies override normal deletion schedules.
Chain Of Custody Documentation
Chain of custody records the chronological history of evidence collection, transfer, analysis, and storage. Maintain detailed logs to demonstrate that discovery data has not been altered.
- Create a chain of custody form for each dataset capturing: matter number, custodian name, date and time of collection, person collecting the data, source device or system, and hash value (MD5 or SHA-256).
- Generate a hash value for each file or dataset at the point of collection using a tool such as File Checksum Integrity Verifier (FCIV) or PowerShell:
Get-FileHash -Path "C:\Discovery\Evidence.docx" -Algorithm SHA256. - Store the hash value and chain of custody form in a read-only evidence folder.
- Log every access, transfer, or export of the data, including date, time, user, and purpose.
- Store chain of custody logs separately from the discovery data to prevent tampering.
Metadata Preservation
Metadata (such as creation date, modification date, author, and email headers) is often as important as the document content itself. Preserve native metadata throughout the eDiscovery process.
- Avoid opening, editing, or saving native files directly from discovery sources, as this can alter metadata.
- Work from forensic copies or read-only mounts of the source data.
- When exporting from email systems, use PST or MSG formats to preserve email headers and attachment structures.
- Document any metadata fields that are critical to your matter, such as sent/received dates, author, and last modified date.
- Verify metadata integrity after any transfer by comparing file properties before and after migration.
Native File Production And Imaged Formats
Understand the difference between native file production and imaged production (such as PDF or TIFF). Australian courts and opposing parties may require native files to preserve metadata and functionality.
- Identify whether the opposing party or court requires native files, imaged files, or both.
- For native production, provide files in their original format (for example,
.docx,.xlsx,.pst,.msg) with associated metadata load files. - For imaged production, convert documents to PDF or TIFF with Bates numbering using eDiscovery software.
- Create a production set containing the produced files, load file, and index.
- Perform quality control checks on a sample of produced files to verify metadata and page counts.
Implementing Retention Policies
Establish clear retention policies to determine how long discovery data must be kept. These policies should align with legal requirements, court rules, and internal firm guidelines.
- Identify the statutory retention period for different types of legal records under Australian law.
- In your backup software, go to Settings > Retention > Create Policy > Name: "Discovery - Civil Matters" > Retention: 7 years after case closure > Save.
- Create a schedule for reviewing and disposing of data that has reached the end of its retention period.
- Document the policy and ensure all staff are trained on the correct handling of discovery materials.
Note: Regularly audit your storage to ensure that obsolete data is securely deleted once the retention period has expired, unless a legal hold is in place.
Defensible Deletion Procedures
Defensible deletion ensures that data is destroyed only after retention periods expire and no legal hold applies. Undisciplined deletion can expose your firm to sanctions and reputational damage.
- Generate a report of all discovery datasets approaching their retention expiry date.
- Cross-reference each dataset against active legal holds and pending matters.
- Obtain written authorisation from the responsible partner before deletion.
- Use secure deletion methods that overwrite data, such as your backup software's secure erase function or a certified data destruction service.
- Record the deletion in your retention log, including matter number, date range, method, and authorising partner.
Archiving Strategies
Archiving moves inactive data to a lower-cost storage tier while keeping it accessible for future reference. This reduces the load on primary storage systems.
- Identify closed cases and move their associated datasets to archive storage.
- Compress files where appropriate to save space, using standard formats such as
.zipor.7z. - Apply metadata tags to archived folders for easy retrieval using case names or matter numbers.
- Schedule periodic integrity checks to ensure archived files have not become corrupted.
Warning: Never store the only copy of critical discovery data on a single device. Always maintain at least one secure backup.
Access Control And Confidentiality
Restrict access to discovery datasets based on role and necessity. Use folder permissions to ensure that only authorised personnel can view or modify sensitive files.
- Enable multi-factor authentication on all storage accounts.
- Use strong, unique passwords for administrative access.
- Review access logs regularly to detect unauthorised activity.
- Implement role-based access control so that paralegals, solicitors, and partners have appropriate levels of access.
For assistance with implementing these strategies or configuring secure storage for your legal practice, Open a Ticket.
Still Having Issues?
💻 Open a Ticket