find the latest legal job
Freelance Project Finance Lawyers
Category: Other | Location: All Australia
· Vario are looking for freelance lawyers with experience in project finance ideally within the renewable energy sector
View details
Vario Freelance Lawyers
Category: Construction Law | Location: All Australia
· We are looking for lawyers who appreciate the endless possibilities that a freelance career can offer.
View details
Freelance Construction Lawyers
Category: Construction Law | Location: All Melbourne VIC
· We are looking for construction lawyers who appreciate the endless possibilities that a freelance career can offer.
View details
Banking Associate - 1-6PQE - Allen & Overy
Category: Banking and Finance Law | Location: United Kingdom
· Banking Associate - 1-6 PQE - Allen & Overy
View details
Academic Dean and Head of School of the TC Beirne School of Law
Category: Other | Location: Brisbane QLD 4000
· An outstanding opportunity · Provide educational, research and organisational leadership
View details
Teaching computers new tricks

Teaching computers new tricks

Law In Order is helping lawyers and computers to work in harmony on large scale litigation, writes Sam Lamble.

Law In Order is helping lawyers and computers to work in harmony on large scale litigation, writes Sam Lamble.

The use of statistical analysis to reveal the meaning of documents – also known as Computer Assisted Review - is part of an ongoing and ever refining set of principles that are helping computers to learn.

This technology is currently deployed in many ways, from Google’s predictive searching, identification of cheating in student assignments and by spy agencies to monitor ‘chatter’ and determine what is being spoken about.

In the sense of a legal review, it is also an integral tool in dealing with the exponential increase in document review and is being harnessed in a number of ways, as can be seen on a recent matter where I provided technology support on a case relating to a large energy company that was involved in litigation over an environmental matter.

The power of one

Only one lawyer was assigned to the case, overseen by one independent consultant—an especially small team, given the 778 GB of data (6.6 million documents in total) collected for the case.

In an effort to save costs, both sides agreed on a list of keywords to help identify relevant documents.

De-duplication and keyword searching culled the client’s original count of 6.6 million documents to a much more manageable 157,000 documents. However, with overly inclusive keywords like ‘environment’ being used, it was evident there were still many non-responsive documents left in the collection to sort out.

Using simple estimates to gauge time and the cost of a traditional review, I calculated  that with the review of 100 documents an hour by a junior lawyer billing out at $200 per hour, the expected cost would be approximately $314,000 and would take about 1570 man hours to complete. The client said that this would not be based on time and cost.

The Assisted Review process

Law In Order proposed using RAR, Relativity’s Assisted Review technology.  Initially, the 157,000 documents were loaded and a random sample of approximately 1,000 documents was reviewed for relevance by the lawyer.

This process was repeated another three times to train the software on responsive versus non-responsive. For each round, six to seven percent of the documents were identified as responsive.

From here, the lawyers ran a Q&A round to check RAR’s accuracy in predicting the responsiveness of the documents in the rest of the database. By taking a statistical sample based on a 95 per cent confidence level and a two percent margin of error, it was deemed that the results were consistent.

Achieving the results

In addition to the consistent results the lawyer only disagreed with the call made by RAR on a small number of documents.  What was most interesting was that he actually changed his original decision to match that of the RAR the majority of the time.

With this realisation and the already low overturn rate in mind, the lawyer felt the computer had achieved a consistent level of accuracy for this case—even after just one Q&A round—and decided to stop the review.

Using Assisted Review, the lawyer was able to complete the first pass review in 10 days and the entire production in approximately a month.

This was a great example of the overwhelming cost and time saving for the client using the Computer Assisted Review Software.  It was even more amazing that we all were confident with the software before it was confident with us.

Sam Lamble is a solutions consultant at Law In Order.

Copy and logo supplied by Law In Order. For more information,
go to

Like this story? Read more:

Book commemorates diamond milestone for WA law society

QLS condemns actions of disgraced lawyer as ‘stain on the profession’

NSW proposes big justice reforms to target risk of reoffending

Teaching computers new tricks
lawyersweekly logo
Promoted content
Recommended by Spike Native Network
more from lawyers weekly
Lawyers take to Twitter to share career stories
Jan 22 2018
Lawyers take to Twitter to share career stories
The #mypathtolaw hashtag has been embraced by legal eagles to swap stories with the Twitter communit...
Jan 22 2018
Legal body disappointed with DPP emails leaked to tabloid
The NSW Bar Association has expressed “profound disappointment” over leaked emails from the NSW ...
Gavel, legal book, criminal lawyers
Jan 19 2018
Three criminal lawyers named NSW magistrates
The NSW Attorney-General has announced the appointment of three new local court magistrates. ...
Allens managing partner Richard Spurio, image courtesy Allens' website
Jun 21 2017
Promo season at Allens
A group of lawyers at Allens have received promotions across its PNG and Australian offices. ...
May 11 2017
Partner exits for in-house role
A Victorian lawyer has left the partnership of a national firm to start a new gig with state governm...
Esteban Gomez
May 11 2017
National firm recruits ‘major asset’
A national law firm has announced it has appointed a new corporate partner who brings over 15 years'...
Nicole Rich
May 16 2017
Access to justice for young transgender Australians
Reform is looming for the process that young transgender Australians and their families must current...
Geoff Roberson
May 11 2017
The lighter side of the law: when law and comedy collide
On the face of it, there doesn’t seem to be much that is amusing about the law, writes Geoff Rober...
May 10 2017
Advocate’s immunity – without fear or without favour but not both
On 29 March 2017, the High Court handed down its decision in David Kendirjian v Eugene Lepore & ...