• Research Tree
  • Features
  • Pricing
  • Events
  • Reg.News
  • Short Interest
  • Explore Content
    • Explore

      • Providers
        • Providers

          • Free/Commissioned
          • High Net Worth Offering
          • Institutional Offering

          Free/Commissioned

          Research that is free to access for all investors. Companies commission these providers to write research about them.

          View Research

          What is our Main Bundle Offering?

          Brokers who write research on their corporate clients and make it available through our main bundle offering.

          View Research

          What is Institutional?

          Research that is paid for directly by asset managers. Only accessible to institutional investors permissioned for access.

          View Research
      • Regions
        • Regions

          • UK
          • Rest of EMEA
          • N America
          • APAC
          • LatAm
      • Exchanges
        • Exchanges

          • Aquis Apex
          • Australian Securities Exchange
          • Canadian Securities Exchange
          • Euronext Paris
          • London Stock Exchange (domestic)
          • SIX Swiss Exchange
      • Sectors
        • Sector Coverage

          • Building & Construction
          • Discretionary Personal Goods
          • Discretionary Retail
          • Energy
          • Health
          • Investment Trusts
          • Media
          • Resources
          • Technology
      • Small / Large Cap
        • Small / Large Cap

          • UK100
          • UK250
          • UK Smallcap
          • UK Other Main Markets
          • Other
  • Login
  • Sign Up
LIVE

Event in Progress:

Join Here ×

working
  • 06 Jun 2024

Will Gen AI hallucinations derail the story? We don’t think so


RELX PLC (REL:LON), 3,969 | Thomson Reuters Corporation (TRI:NAS), 0

  • BNP Paribas Exane
    • Packer William WP | Kassab Sami SK

    • 12 pages


 

This content is only available within our institutional offering.

Sign in

This content is only available to commercial clients. Sign in if you have access or contact support@research-tree.com to set up a commercial account

This content is only available to commercial clients. Sign in if you have access or contact support@research-tree.com to set up a commercial account


Sign In
Not a commercial user? Register here for our wider research bundle

Will Gen AI hallucinations derail the story? We don’t think so


RELX PLC (REL:LON), 3,969 | Thomson Reuters Corporation (TRI:NAS), 0

  • Published: 06 Jun 2024
  • Author: Packer William WP | Kassab Sami SK
  • Pages: 12
  • BNP Paribas Exane


A new Stanford University research paper shows Legal Gen AI tools hallucinate A preprint study from researchers at Stanford''s RegLab and Institute for Human-Centered AI that is currently under review provides the first comparative examination of Legal Gen AI tools and shows that Relx''s Lexis+ AI and Thomson Reuters'' Westlaw Gen AI research tools hallucinate less frequently than ChatGPT. However, it also shows that these tools still tend to hallucinate quite a lot. 17% to 33% hallucination rates The study, based on 202 complex queries, shows that Relx Lexis+AI and Thomson Reuters Westlaw demonstrated hallucination rates (i.e. inaccurate or nonsensical outputs) of 17% and 33% respectively, and only 65% and 42% accuracy rates. We consider these to be very high rates of inaccurate answers and believe such results could cool the hype around Legal Gen AI tools for users and investors alike. We note Relx''s product performed significantly better than Thomson Reuters''. No change in forecasts and views While we admit this study provides a cause for concern, we are not yet changing our outlook. For one, we continue to believe in the productivity gains Gen AI tools offer and point to the many limitations noted by Stanford University researchers in their own study. Secondly, we also note that these tools offer access to the references used by the system and that it is lawyers'' responsibility to check the sources used by the AI. Thirdly, we believe such studies will help vendors improve on the current state of their technology. Fourthly, Stanford noted that the prompts used may not be reflective of the complexity of real-world queries. Effective real-world hallucination rates may actually be lower. Prefer Relx over Thomson Reuters While we believe the study has limited implications at this time, we also see the superior performance of Relx''s product as reinforcing our preference for Relx shares over the more expensively valued Thomson Reuters. Relx''s H1 results...

More Content

More Content

VSA Capital Tech & Transitional Energy 130225

Companies: FTCPRVRSWITMRELIKAGELN

VSA Capital

Perfectly well executed indeed

Companies: RELX PLC

AlphaValue

FTSE 100 starts week lower as GDP stalls; Aviva firms up Direct Line offer - Market Report

Companies: RELX PLC

Proactive

All businesses continuing to show underlying growth…

Companies: RELX PLC

AlphaValue

Q3 23: All clear for RELX

Companies: RELX PLC

AlphaValue
Research Tree
Useful Links
  • Features
  • Pricing
  • RNS/Newswires Feeds
  • Providers Hub
  • Company Hub
  • Stock Pick League
  • Chrome Extension
  • iOS and Android Apps
Account
  • Login
  • Join Now
  • Contact
  • Follow us on Linkedin
  • Follow us on X

© Research Tree 2025

  • Apple Store
  • Play Store
  • Terms of Service
  • Privacy Policy and Statement on Cookies

Research Tree will never share your details with third parties for marketing purposes. Research Tree distributes research documents that have been produced and approved by Financial Conduct Authority (FCA) Authorised & Regulated firms as well as relevant content from non-authorised sources, who are not regulated but the information is in the public domain. For the avoidance of doubt Research Tree is not giving advice, nor has Research Tree validated any of the information.

Research Tree is an Appointed Representative of Sturgeon Ventures which is Authorised and Regulated by the Financial Conduct Authority.

Top
  • Home
  • Features
  • Pricing
  • Event Hub
  • Reg.News
  • Short Interest Tracker
  • Explore Content
    • Regions
      • UK
      • Rest of EMEA
      • N America
      • APAC
      • LatAm
    • Exchanges
      • Aquis Apex
      • Australian Securities Exchange
      • Canadian Securities Exchange
      • Euronext Paris
      • London Stock Exchange (domestic)
      • SIX Swiss Exchange
    • Sectors
      • Automobile Industry
      • Banks
      • Building & Construction
      • Chemicals
      • Discretionary Personal Goods
      • Discretionary Retail
      • Energy
      • ETFs
      • Financial Services
      • Food & Drink
      • Food Production
      • Health
      • Household Goods & DIY
      • Industrial Equipment, Goods & Services
      • Insurance & Reinsurance
      • Investment Trusts
      • Leisure, Tourism & Travel
      • Media
      • Open-ended Funds
      • Other
      • Real Estate
      • Resources
      • Staple Retail
      • Technology
      • Telecoms
      • Utilities
    • Small / Large Cap
      • UK100
      • UK250
      • UK Smallcap
      • UK Other Main Markets
      • Other
    • Private/EIS
      • EIS Single Company
      • EIS/SEIS Funds
      • IHT Products
      • SEIS Single Company
      • VCT Funds
  • Providers
    • Free/Commissioned
      • Acquisdata
      • Actinver
      • Actio Advisors
      • Asset TV
      • Atrium Research
      • Baden Hill
      • BlytheRay
      • BNP Paribas Exane - Sponsored Research
      • Bondcritic
      • Brand Communications
      • BRR Media
      • Calvine Partners
      • Capital Access Group
      • Capital Link
      • Capital Markets Brokers
      • Cavendish
      • Checkpoint Partners
      • Clear Capital Markets
      • Couloir Capital
      • Doceo
      • Edison
      • Engage Investor
      • Equity Development
      • eResearch
      • First Equity
      • Five Minute Pitch TV
      • focusIR
      • Fundamental Research Corp
      • Galliano’s Latin Notes
      • GBC AG
      • goetzpartners securities Limited
      • Golden Section Capital
      • GreenSome Finance
      • GSBR Research
      • H2 Radnor
      • Hardman & Co
      • Holland Advisors
      • Hypothesis Research
      • InterAxS Global
      • Kepler | Trust Intelligence
      • London Stock Exchange
      • Longspur Clean Energy
      • Mello Events
      • Messari Research
      • Nippon Investment Bespoke Research UK
      • NuWays
      • OAK Securities
      • Oberon Capital
      • Optimo Capital
      • Panmure Liberum
      • Paul Scott
      • Peel Hunt
      • PIWORLD (hosted by Progressive)
      • Proactive
      • Progressive Equity Research
      • Quantum Research Group
      • QuotedData
      • Research Dynamics
      • Research Tree
      • Resolve Research
      • SEAL Advisors Ltd
      • ShareSoc
      • Shore Capital
      • Sidoti & Company
      • Small Cap Consumer Research LLC
      • StockBox
      • Tennyson Securities
      • The AIC
      • The Business Magazine Group
      • The Edge Group
      • The Life Sciences Division
      • Trinity Delta
      • Turner Pope Investments
      • UK Investor Group
      • ValueTrack
      • Vox Markets
      • VRS International S.A. - Valuation & Research Specialists (VRS)
      • VSA Capital
      • Winterflood Securities
      • Yaru Investments
      • Yellowstone Advisory
      • Zacks Small Cap Research
      • Zeus Capital
    • High Net Worth Offering
      • Fox-Davies Capital
      • ABG Sundal Collier
      • ACF Equity Research
      • Align Research
      • Allenby Capital
      • AlphaValue
      • Alternative Resource Capital
      • Arctic Securities
      • Arden Partners
      • Auctus Advisors
      • Baptista Research
      • BNP Paribas Exane - Sponsored Research
      • Canaccord Genuity
      • Cavendish
      • Couloir Capital
      • Degroof Petercam
      • Dowgate Capital
      • First Berlin
      • First Equity
      • First Sentinel
      • Greenwood Capital Partners
      • Hannam & Partners
      • Hybridan
      • Kemeny Capital
      • Longspur Clean Energy
      • Louis Capital
      • Magnitogorsk Iron and steel works
      • Medley Global Advisors
      • Northland Capital Partners
      • OAK Securities
      • Oberon Capital
      • Panmure Liberum
      • QuotedData Professional
      • Shard Capital
      • ShareSoc
      • Shore Capital
      • Singer Capital Markets
      • SP Angel
      • Stanford Capital Partners
      • Stifel FirstEnergy
      • Stockdale Securities
      • Tamesis Partners
      • Tennyson Securities
      • The Life Sciences Division
      • Turner Pope Investments
      • VSA Capital
      • Whitman Howard
      • Yellowstone Advisory
      • Zeus Capital
    • Institutional Offering
      • Fox-Davies Capital
      • ABG Sundal Collier
      • ACF Equity Research
      • Acquisdata
      • Allenby Capital
      • Alternative Resource Capital
      • Arctic Securities
      • Arden Partners
      • Auctus Advisors
      • BNP Paribas Exane
      • Bondcritic
      • Canaccord Genuity
      • Capital Access Group
      • Capital Link
      • Cavendish
      • Couloir Capital
      • Degroof Petercam
      • Dowgate Capital
      • Edison
      • First Berlin
      • First Equity
      • First Sentinel
      • Five Minute Pitch TV
      • Fundamental Research Corp
      • Galliano’s Latin Notes
      • GBC AG
      • Golden Section Capital
      • Goodbody
      • Greenwood Capital Partners
      • Hannam & Partners
      • Holland Advisors
      • Hybridan
      • InterAxS Global
      • Investec Bank
      • Kepler | Trust Intelligence
      • Numis
      • NuWays
      • OAK Securities
      • Oberon Capital
      • Panmure Liberum
      • Peel Hunt
      • QuotedData
      • QuotedData Professional
      • Research Dynamics
      • Research Tree
      • Shard Capital
      • Shore Capital
      • Sidoti & Company
      • Singer Capital Markets
      • Small Cap Consumer Research LLC
      • SP Angel
      • Stanford Capital Partners
      • Stifel
      • StockBox
      • Tamesis Partners
      • Tennyson Securities
      • The AIC
      • The Business Magazine Group
      • The Life Sciences Division
      • ValueTrack
      • Velocity Trade
      • VSA Capital
      • Winterflood Securities
      • Zacks Small Cap Research
      • Zeus Capital
  • Contact
  • Sign Up
  • Sign In