LLM selection for law firms: Key insights from industry leaders at Legalweek 2025

As large language models (LLMs) reshape legal practice, firms face complex decisions about which AI tools to adopt and how to integrate them effectively. At Legalweek 2025, a panel of legal innovation leaders—Ken Jones (TK Trial), Jessica Lee (Loeb & Loeb), and Thor Alden (Dechert)—shared practical insights on strategic AI implementation.

Here are six actionable takeaways for knowledge management and innovation leaders evaluating AI technologies:

1. Develop a nuanced framework for data sensitivity

Privacy considerations remain paramount in LLM conversations in the legal industry. While client confidentiality is a concern, the panel emphasized the crucial distinction between confidential and privileged information. The panelists stressed that the context matters significantly more than data categorization alone—how information is used, who can access it, and permissible actions with that data are critical factors.

Understanding these subtleties, especially recognizing appropriate use cases for different AI systems based on data sensitivity, is essential when matching potential models to specific practice groups or client needs.

The panel highlighted that legal practice fundamentally revolves around client service. Therefore, developing clear frameworks and security protocols to help clients understand AI utilization is becoming increasingly vital. Simply yielding to generalized client concerns about AI without nuanced discussion risks:

• Limiting the transformative efficiency potential throughout the deal cycle
• Putting firms at a competitive disadvantage as AI adoption accelerates across the industry
• Missing opportunities to develop firm-specific expertise in emerging technologies

2. Encourage practical experimentation within boundaries

The panel strongly advocated for a "try it and see" methodology, agreeing that hands-on experience with AI tools provides insights impossible to gain through theoretical discussions alone. Several practical implementation approaches were suggested:

• Create sandbox environments where team members can experiment with AI tools using non-sensitive data
• Introduce AI technology outside critical work tasks as a low-risk entry point
• Begin with non-confidential use cases like marketing analysis, competitive intelligence, or media monitoring
• Establish "innovation hours" where attorneys can explore potential applications without billing pressure

While frameworks and processes have their place, there's tremendous value in moving quickly, trying, sometimes failing, and iterating. This prevents teams from getting trapped in endless theoretical discussions without practical progress.

Attorneys who initially express skepticism often become the strongest advocates after seeing concrete benefits in their specific practice areas.

3. Integration with existing systems determines adoption

The panel reached consensus that adoption rates increase dramatically when new tools connect seamlessly with current workflows. Integration capability is often more important than advanced features—it's significantly easier when a tool plugs into a firm's existing systems. Without strong integration, firms need to build an exceptionally compelling business case to overcome workflow disruption.

The key takeaway for technology leaders is to evaluate vendors not solely on their AI capabilities but equally on their integration options with:

• Document management systems
• Communication platforms
• Time and billing software
• Knowledge management repositories
• Client portals and collaboration tools

The most sophisticated AI solution will struggle to gain traction if it requires attorneys to significantly alter their established work patterns or switch between multiple platforms.

4. Implement a focused, phased approach

Rather than attempting enterprise-wide rollouts, the panelists unanimously endorsed targeted implementations that:

• Identify well-defined, high-value problems where AI can provide clear benefits
• Design a phased implementation plan starting with a small group of tech-receptive users
• Document early successes with quantifiable metrics to build momentum for wider adoption
• Create dedicated feedback channels to continuously refine the implementation strategy

The firms seeing the most success are those approaching LLM adoption systematically rather than attempting enterprise-wide implementation immediately. Targeted solutions addressing specific pain points generate enthusiasm that drives organic expansion.

5. Establish clear LLM selection criteria aligned with firm strategy

The panel outlined the importance of establishing transparent criteria for evaluating potential LLM implementations. These criteria should reflect the firm's strategic priorities and specific practice needs:

• Security capabilities: Data residency options, encryption standards, access controls
• Transparency: Model documentation, explainability of outputs
• Customization: Ability to train on firm-specific content and terminology
• Vendor stability: Financial outlook, commitment to legal industry
• Support resources: Training, implementation assistance, technical support

The panelists recommended creating a standardized evaluation matrix to ensure objective comparison across solutions while reflecting each firm's risk tolerance and strategic priorities.

6. Foster a culture of continuous learning and adaptation

The rapidly evolving nature of LLM technology demands ongoing education across the organization. The panel recommended:

• Regular technology showcases highlighting successful implementations across practice groups
• Peer-to-peer knowledge sharing sessions where early adopters can demonstrate practical applications
• Developing internal AI champions who can provide guidance and support to colleagues
• Creating mechanisms to capture and disseminate lessons learned from both successes and failures

This isn't a one-time implementation but an ongoing journey. The firms that establish learning mechanisms now will be better positioned to adapt as the technology inevitably continues to evolve.

Strategic implementation is key to success

By thoughtfully addressing these six crucial areas, knowledge management and innovation leaders can drive successful LLM adoption that enhances their firm's capabilities while respecting the unique requirements of legal practice. The panel's insights suggest that the most successful firms will be those that balance experimentation with appropriate governance, ensuring they capitalize on AI's transformative potential without compromising their professional obligations.

We're past the question of whether AI will transform legal practice. The question now is which firms will successfully navigate that transformation to deliver greater value to their clients while maintaining the highest professional standards.

‍