Together Together Open Deep Research CookBook

Together Open Deep Research CookBook

alph-notebooks/together-cookbook / Together_Open_Deep_Research_CookBook.ipynb

Export

Run Notebooks

Contents

No cells yet

Add cells to see them here

Together's Open Deep Research Cookbook: An Efficient and Open Source Implementation with Multi-Step Web Search

Authors: Shang Zhu, Federico Bianchi, Zhichao Li, Ben Athiwaratkun, Albert Meixner, James Zou

Introduction

Welcome to the Together's Open Deep Research Cookbook! This guide demonstrates how to answer complex research questions with comprehensive, evidence-based reports by combining the power of large language models (LLMs) with structured web search techniques.

We break down the research process into clear, modular steps that can be understood, customized, and improved independently. This modularity makes advanced research capabilities accessible and adaptable to diverse research needs.

Together's Open Deep Research Workflow

Our Deep Research framework offers several key advantages:

Progressive Exploration: Starting with initial queries derived from your research topic, the system intelligently explores information, identifies gaps, and refines its search strategy.
Evidence-Based Synthesis: All findings are grounded in verified sources with proper citations, reducing the hallucinations common in pure LLM-based question and answering.
Adaptive Search with Completeness Evaluation: The system evaluates information gaps against research goals and generates targeted follow-up queries for missing specifics. This ensures resources focus precisely on completing your research rather than collecting redundant information.
Source Filtering: Not all information is equally valuable - our system evaluates and prioritizes the most relevant and reliable sources.
Structured Output: Results are presented as well-organized reports with clear sections, cohesive narratives, and proper citations.

Cookbook Contributions

Set up a flexible research environment with configurable parameters
Process complex topics through a multi-stage research pipeline
Generate high-quality reports for the given research topic

The functional design pattern we showcase makes each step transparent and customizable, allowing you to adapt the system to specific domains or research styles. Each function handles a specific part of the research process, from query generation to answer synthesis, with explicit inputs and outputs that can be tested and improved independently.

Whether you're a researcher, student, analyst, or curious explorer, this cookbook provides the tools to transform your research questions into comprehensive, evidence-based reports that would normally require hours of manual work.

Let's begin our exploration of AI-powered research!

Install packages

[ ]

Initialize necessary functions and configuration

[ ]

Data Model Definitions

Before diving into the research functionality, we need to define the data structures that will represent our research plan, search results, and source evaluation. These models provide a structured way to handle the different types of data flowing through our research pipeline.

The data model consists of several key components:

ResearchPlan: Structures the initial research plan with search queries generated by the LLM
SourceList: Captures the filtered list of relevant sources chosen by the LLM
SearchResult: Represents an individual search result with its metadata and content
SearchResults: A collection of search results with utilities for manipulation and display

These structured data models allow us to maintain organization throughout the research process, from query generation to final report synthesis.

The first two will be pydantic base classes, and it will be used for JSON mode. The latter two will instread be more general dataclasses.

[ ]

Deep Research Configuration Parameters

This section defines the key parameters that control the Deep Research process. These configuration settings allow you to customize the research behavior, model selection, and output format according to your specific needs.

The parameters include:

Model Selection: Defines which LLMs to use for different stages of the research process
Research Budget: Controls the number of research cycles performed, with higher values enabling more thorough but time-consuming exploration
Query Limits: Sets boundaries on how many search queries to generate and execute
Source Management: Configures the maximum amount of sources to be considered in the final synthesis (avoid ultra-long context that may break the context window)
Prompt Templates: Defines the instruction prompts utilized for selected models.

Adjust these parameters to balance depth, speed, and resource usage according to your research priorities.

Disclaimers ⚠️

For readability, here we provide rather simple prompts but we encourage you to optimize them as needed.

This workflow involves multiple LLM calls and search API calls, so we remind the user to be mindful about the resource management as defined in the following code block.

Be sure to understand that this code will make API requests to other services. Specifically, you will need Tavily API key (get it here) and Together API key (get it here).

[ ]

Building the Research Pipeline

STEP 1: Query Generation - Breaking Down the Research Question

In this first stage, we transform the broad research topic into specific, targeted search queries. This crucial step determines what information we'll gather and sets the foundation for the entire research process.

[ ]

In generate_research_queries function: We use a two-model approach where the planning model creates comprehensive research strategies, then the JSON model structures these into precisely formatted queries. This ensures both creative planning and reliable structured output.

The generate_initial_queries function wraps this process, applying query limits and providing additional validation and logging before returning the final set of targeted search queries.

Let's demonstrate this process with a practical example, using the research topic: "The impact of artificial intelligence on the manufacturing industry" This multifaceted subject provides an excellent case study for showing how our system breaks down complex topics into targeted queries.

Note: In rare cases we saw none initial queries were generated, where rerunning the cell would typically resolve the issue.

[ ]

Generated plan: To effectively research the impact of artificial intelligence (AI) on the manufacturing industry, you can break down the topic into several focused, specific, and self-contained queries. Each query will help gather relevant information that contributes to a comprehensive understanding of the topic. Here are the queries:

1. **Overview of AI in Manufacturing:**
- What are the key applications of AI in the manufacturing industry?
- How has the adoption of AI in manufacturing evolved over the past decade?

2. **Economic Impact:**
- What are the economic benefits of AI in manufacturing, such as cost reduction and efficiency gains?
- How has AI influenced the job market in the manufacturing sector, including job creation and displacement?

3. **Operational Efficiency:**
- How does AI improve production efficiency and quality control in manufacturing?
- What are the specific AI technologies (e.g., machine learning, robotics, predictive maintenance) used to enhance operational efficiency?

4. **Supply Chain Management:**
- How does AI optimize supply chain management in manufacturing?
- What are the best practices for integrating AI into supply chain operations?

5. **Product Innovation:**
- How does AI drive product innovation in the manufacturing industry?
- What are some examples of AI-driven product developments in manufacturing?

6. **Challenges and Barriers:**
- What are the main challenges and barriers to AI adoption in manufacturing?
- How do regulatory and ethical considerations impact the use of AI in manufacturing?

7. **Case Studies:**
- Provide case studies of successful AI implementations in manufacturing companies.
- What lessons can be learned from these case studies?

8. **Future Trends:**
- What are the emerging trends in AI for manufacturing?
- How is the future of manufacturing likely to be shaped by AI?

9. **Stakeholder Perspectives:**
- What are the perspectives of key stakeholders (e.g., manufacturers, policymakers, employees) on the impact of AI in manufacturing?
- How are these perspectives influencing the adoption and development of AI technologies?

10. **Comparative Analysis:**
- How does the impact of AI in manufacturing compare to other industries?
- What are the unique aspects of AI's impact on the manufacturing sector?

By addressing these queries, you can build a robust and detailed research report on the impact of artificial intelligence on the manufacturing industry. Each query is designed to provide a specific piece of the puzzle, contributing to a comprehensive understanding of the topic.

Initial queries: ['What are the key applications of AI in the manufacturing industry?', 'How has the adoption of AI in manufacturing evolved over the past decade?']

Below are the targeted queries generated by our system, demonstrating how the general research topic has been decomposed into specific, searchable questions. Each query addresses a distinct aspect of AI's impact on the manufacturing industry:

[ ]

['What are the key applications of AI in the manufacturing industry?',
, 'How has the adoption of AI in manufacturing evolved over the past decade?']

STEP 2: Information Gathering - Searching and Processing Web Content

Now that we have our targeted queries, we move to the information gathering phase. This step involves two critical processes:

Web Search: Executing our queries against web sources to retrieve relevant information
Content Processing: Filtering and summarizing the raw content to extract what's most relevant to our research, using an LLM (summary_model).

Let's first examine a single search operation (using Tavily Search API as an example) to understand the core mechanics:

[ ]

To demonstrate the search and content processing mechanism, let's execute a single search using the first query from our generated list. This allows us to examine in detail how the system retrieves and processes information before we implement the full multi-query research workflow:

[ ]

Perform Tavily search with query: What are the key applications of AI in the manufacturing industry?
Tavily Responded with 10 results (Tavily returning None will be ignored for summarization)
Summarizing content asynchronously using the LLM
Summarizing content asynchronously using the LLM
Summarizing content asynchronously using the LLM
Summarizing content asynchronously using the LLM
Summarizing content asynchronously using the LLM
Summarizing content asynchronously using the LLM
Summarizing content asynchronously using the LLM
Summarizing content asynchronously using the LLM
Summarizing content asynchronously using the LLM
Summarizing content asynchronously using the LLM

Below is an example of the first retrieved and summarized result. Note how the system has not only found relevant content but also processed it to extract information specifically related to our research topic. This demonstrates the content filtering capabilities that make our research pipeline more effective than simple search retrieval:

[ ]

Title: How Is AI Used in Manufacturing: Examples, Use Cases, and Benefits

Link: https://www.azumuta.com/blog/how-is-ai-used-in-manufacturing-examples-use-cases-and-benefits/

Content: **Key Applications of AI in the Manufacturing Industry**

Artificial intelligence (AI) is transforming the manufacturing landscape by enhancing efficiency, innovation, and productivity. The five main AI applications in manufacturing include:

1. **Predictive Maintenance**: AI analyzes data from sensors, equipment telemetry, and other sources to forecast equipment failures, allowing for proactive maintenance scheduling, minimizing downtime, and reducing costs.
2. **AI-Enhanced Quality Control**: AI-powered computer vision systems detect defects or anomalies in products, ensuring quality and safety. Machine learning algorithms are trained on labeled datasets to recognize patterns associated with defects.
3. **Supply Chain Optimization**: AI predicts demand fluctuations, optimizes inventory, and identifies potential disruptions. It analyzes large volumes of data, including sales data, customer behavior, economic indicators, and external factors.
4. **Intelligent Automation**: AI combines [...]

Executing the Complete Initial Search Process

Now that we understand how a single search works, let's implement the parallel search process that executes all our initial queries simultaneously. This approach significantly improves efficiency by:

Running multiple search operations concurrently
Processing all results in parallel
Combining findings into a comprehensive result set

Disclaimer: This step involves multiple LLM runs processing long web texts, so we remind the user to be mindful about the resource management as defined at the beginning.

This demonstrates a key advantage of our functional pipeline architecture:

[ ]

Perform Tavily search with query: What are the key applications of AI in the manufacturing industry?
Perform Tavily search with query: How has the adoption of AI in manufacturing evolved over the past decade?
Tavily Responded with 10 results (Tavily returning None will be ignored for summarization)
Summarizing content asynchronously using the LLM
Summarizing content asynchronously using the LLM
Summarizing content asynchronously using the LLM
Summarizing content asynchronously using the LLM
Summarizing content asynchronously using the LLM
Summarizing content asynchronously using the LLM
Summarizing content asynchronously using the LLM
Summarizing content asynchronously using the LLM
Summarizing content asynchronously using the LLM
Summarizing content asynchronously using the LLM
Tavily Responded with 10 results (Tavily returning None will be ignored for summarization)
Summarizing content asynchronously using the LLM
Summarizing content asynchronously using the LLM
Summarizing content asynchronously using the LLM
Summarizing content asynchronously using the LLM
Summarizing content asynchronously using the LLM
Summarizing content asynchronously using the LLM
Summarizing content asynchronously using the LLM
Summarizing content asynchronously using the LLM
Summarizing content asynchronously using the LLM
Summarizing content asynchronously using the LLM
Search complete, found 9 results after deduplication

Below is the complete set of results from our parallel search operations, consolidated into a single collection. This demonstrates how our system gathers diverse information across multiple queries while maintaining organization. The results include sources addressing different aspects of our research topic, providing a foundation for comprehensive analysis.

[ ]

First 10000 characters of 9 results:

[1] Title: How Is AI Used in Manufacturing: Examples, Use Cases, and Benefits
Link: https://www.azumuta.com/blog/how-is-ai-used-in-manufacturing-examples-use-cases-and-benefits/
Refined Content: **Key Applications of AI in the Manufacturing Industry**

Artificial intelligence (AI) is transforming the manufacturing landscape by enhancing efficiency, innovation, and productivity. The five main AI applications in manufacturing include:

1. **Predictive Maintenance**: AI analyzes data from sensors, equipment telemetry, and other sources to forecast equipment failures, allowing for proactive maintenance scheduling, minimizing downtime, and reducing costs.
2. **AI-Enhanced Quality Control**: AI-powered computer vision systems detect defects or anomalies in products, ensuring quality and safety.
3. **Supply Chain Optimization**: AI predicts demand fluctuations, optimizes inventory, and identifies potential disruptions, enabling manufacturers to make informed decisions about production, procurement, and resource allocation.
4. **Intelligent Automation**: AI automates tasks beyond repetition by combining intelligent software and robotic equipment, improving efficiency, flexibility, and ergonomics in manufacturing operations.
5. **AI-Driven Training and Assistance**: AI-powered digital tools create clear and accurate work instructions, improving operational efficiency and productivity.

**AI Technologies Used in Manufacturing**

Some key AI technologies used in manufacturing include:

1. **Machine Learning**: enables machines to learn from data, identify patterns, and make decisions.
2. **Deep Learning**: a subset of machine learning that recognizes patterns using many processing layers, useful for image and speech recognition.
3. **Natural Language Processing (NLP)**: enables machines to understand, interpret, and generate human language.
4. **Computer Vision**: allows machines to interpret and understand visual information from images or videos.
5. **Robotics**: combines AI with mechanical engineering to create machines that perform tasks autonomously or with minimal human intervention.

**Real-World Examples of AI in Manufacturing**

1. **BMW Group**: uses AI to automate quality processes in the conveyor belt, analyzing data recorded by cameras and sensor technology.
2. **Ford**: integrates AI into assembly lines with robot arms that learn the most efficient way to assemble parts.
3. **Rolls Royce**: uses digital twins and AI to consolidate data from produced engines, monitoring performance, predicting potential issues, and optimizing maintenance schedules.

**Benefits of AI in Manufacturing**

1. **Cost Savings**: AI reduces operational costs through optimized processes and decreased downtime.
2. **Data-Driven Decision-Making**: AI analyzes vast amounts of data to identify trends and patterns, providing valuable insights for optimizing production processes.
3. **Supply Chain Optimization**: AI optimizes supply chain logistics, inventory management, and procurement processes.
4. **Improved Safety**: AI improves workplace safety by combining automation, real-time monitoring, and predictive analytics.
5. **Enhanced Product Quality**: AI-powered vision systems inspect products with greater accuracy and speed than human inspectors.

[2] Title: The Rise of AI in Manufacturing: 2025 Trends, Tools & Real-World Impact
Link: https://www.authentise.com/post/the-rise-of-ai-in-manufacturing-2025-trends-tools-real-world-impact
Refined Content: Here is the extracted and synthesized information relevant to the research topic:

**Key Applications of AI in Manufacturing:**

1. **Predictive Maintenance**: AI systems can predict equipment failures before they occur, reducing unplanned downtime by up to 50% and cutting maintenance costs by 30%.
2. **Quality Control**: Advanced machine vision systems, powered by deep learning algorithms, detect defects and deviations with unprecedented accuracy, ensuring higher product quality and reducing waste.
3. **Automation of Documentation and Compliance**: AI can automate documentation, traceability, and compliance, reducing manual entry and enabling proactive quality checks.
4. **Materials Management**: Predictive intelligence can help manufacturers plan, track, and reclaim materials more effectively, cutting costs and reducing waste.
5. **Engineering Collaboration**: AI-powered platforms capture and contextualize intent from conversations, drawings, and data streams, ensuring decisions don't get lost.
6. **Human-Machine Collaboration**: AI has led to the development of humanoid robots capable of performing complex tasks alongside human workers.
7. **Smart Manufacturing**: AI enables real-time decision-making, near-autonomous systems, and seamless human-machine collaboration, enhancing flexibility and responsiveness in production environments.

**Benefits of AI in Manufacturing:**

* Reduced conversion costs by up to 20%
* Improved workforce productivity
* Enhanced troubleshooting processes
* Increased efficiency and reduced costs
* Improved product quality and reduced waste

**Companies Using AI in Manufacturing:**

* Siemens
* Microsoft (Factory Operations Agent)
* Nvidia
* Figure AI
* Authentise (integrating AI into core manufacturing workflows)

**Trends and Future Directions:**

* The emergence of "AI factories" where companies operate dual production lines - one for traditional products and another dedicated to AI model training and deployment.
* The need for continuous upskilling of the workforce to effectively collaborate with intelligent systems.
* The importance of addressing ethical considerations surrounding data privacy and job displacement.

[3] Title: AI in Manufacturing: The Smart Revolution in Industry
Link: https://sigmatechnology.com/articles/the-application-of-ai-in-manufacturing/
Refined Content: **Key Applications of AI in the Manufacturing Industry**

Based on the provided content, the key applications of AI in the manufacturing industry are:

1. **Predictive Maintenance**: AI-powered predictive maintenance helps prevent downtime by monitoring machine performance, detecting anomalies, and scheduling repairs during planned downtime.
2. **Quality Control and Inspection**: AI-driven computer vision systems enable automated defect detection, ensuring high-quality output and reducing waste.
3. **Supply Chain Efficiency**: AI analyzes vast datasets to anticipate demand fluctuations, optimize inventory levels, and automate order fulfillment, leading to operational efficiency and reduced waste.
4. **Collaborative Robots (Cobots)**: AI-powered cobots work safely alongside human employees, taking over repetitive tasks and freeing up skilled workers to focus on complex and creative aspects of the manufacturing process.
5. **Digital Twins**: AI-driven digital twins simulate production processes, enhancing predictive analytics, anticipating equipment failures, and optimizing workflows.
6. **Machine Learning (ML) and Deep Learning**: ML algorithms detect inefficiencies in production processes, predict demand, and optimize supply chains, while deep learning enables visual inspection and quality control.
7. **Sensor Data Analytics (IoT + AI)**: AI processes data from IoT sensors to enable predictive maintenance, optimize energy consumption, and ensure quality control.
8. **Computer Vision**: AI-powered computer vision systems enable automated defect detection, assembly line monitoring, and workplace safety.
9. **Edge AI**: Edge AI brings AI processing directly to manufacturing devices, enabling real-time decision-making, autonomous manufacturing systems, and instant quality control.

**Transformative Benefits of AI in Manufacturing**

The integration of AI in manufacturing offers several benefits, including:

1. **Cost Reduction and Increased Operational Efficiency**: AI-powered automation streamlines processes, reducing the need for human intervention in repetitive tasks and minimizing costly errors.
2. **Customized Production and Dynamic Supply Chain Management**: AI enables manufacturers to offer customized products efficiently, blending the advantages of mass production with the appeal of one-off design.
3. **Improved Sustainability**: AI optimizes energy consumption, minimizes environmental impact, and enhances the skills of the workforce.

**Challenges and Lessons Learned**

The content also highlights the challenges of AI implementation in manufacturing, including:

1. **Managing Data Privacy and Security**: Protecting sensitive data from breaches and misuse is critical.
2. **Bridging the AI Skills Gap**: Manufacturers need targeted reskilling and upskilling initiatives to close the skills gap.
3. **Overcoming Cultural Resistance**: Creating an inclusive and supportive culture around AI implementation is essential.
4. **Ensuring Ethical and Transparent AI Use**: Clear ethical guidelines and transparent AI processes build trust among employees, partners, and customers.

By understanding these key applications, benefits, and challenges of AI in manufacturing, companies can successfully leverage AI's full potential, securing a competitive advantage in an increasingly digital and sustainability-focused market.

[4] Title: Manufacturing AI: Top 15 tools & 13 real-life use cases ['25] - AIMultiple
Link: https://research.aimultiple.com/manufacturing-ai/
Refined Content: Here is the extracted and synthesized information relevant to the research topic:

**Key Applications of AI in the Manufacturing Industry:**

1. **Predictive Maintenance**: AI analyzes sensor data to forecast equipment failures, allowing for scheduled maintenance and reducing downtime. (Example: PepsiCo’s Frito-Lay plants saved costs and improved equipment performance using AI-driven predictive maintenance.)
2. **Generative Design**: AI algorithms generate multiple design options based on parameters, enabling manufacturers to quickly produce thousands of designs. (Example: Airbus reduced aerodynamics prediction times from

...

Last 10000 characters of 9 results:

ce/article/pii/S000785062400115X
Refined Content: Here is the extracted and synthesized information relevant to the research topic:

**Evolution of AI in Manufacturing over the past decade:**

The adoption of Artificial Intelligence (AI) in manufacturing has seen accelerated growth since the beginning of the 21st century, particularly with the advent of Industry 4.0. Over the past decade, AI has been increasingly applied in various manufacturing areas, including:

1. **Production system design and planning**: AI has been used to optimize production planning and design, enabling more efficient and flexible manufacturing systems.
2. **Process modeling and optimization**: AI techniques, such as machine learning, have been applied to model and optimize manufacturing processes, improving their efficiency and effectiveness.
3. **Quality assurance**: AI has been used to enhance quality control and assurance in manufacturing, enabling real-time monitoring and prediction of product quality.
4. **Maintenance**: AI-powered predictive maintenance has become more prevalent, allowing for proactive maintenance scheduling and reducing equipment downtime.
5. **Automated assembly and disassembly**: AI has been applied to automate assembly and disassembly processes, improving manufacturing efficiency and reducing labor costs.

**Current State and Future Directions:**

The current state of AI in manufacturing is characterized by the development of **smart manufacturing** systems, which leverage AI, machine learning, and data analytics to optimize production processes. Future research directions are expected to focus on:

1. **Leveraging AI towards smart manufacturing**: Further developing AI solutions to realize smart manufacturing systems that are highly efficient, flexible, and autonomous.
2. **Matching AI solutions to manufacturing problems**: Identifying representative manufacturing problems and matching them with suitable AI solutions to drive innovation and improvement.

Overall, the adoption of AI in manufacturing has evolved significantly over the past decade, with a growing focus on applications such as machine learning, smart manufacturing, and process optimization.

[7] Title: The Evolution of AI in Manufacturing - Augmentir
Link: https://www.augmentir.com/blog/the-evolution-of-ai-in-manufacturing
Refined Content: **Evolution of AI in Manufacturing: A Decade of Progress**

The adoption of AI in manufacturing has undergone significant evolution over the past decade, transforming from a focus on automation and replacement of human workers to augmenting and supporting frontline workers. Here's a synthesis of the relevant information:

**Early Adoption (1960s-2019)**

1. **Automation and Robotics**: AI was initially used in manufacturing to automate manual, repetitive tasks such as assembly, parts handling, and sorting.
2. **Machine Vision Systems**: AI-enabled machine vision systems were used to automate visual inspections, improving quality control and precision.
3. **Industrial Internet of Things (IIoT)**: AI was integrated with IIoT to enable predictive analytics for machine health monitoring and optimize operations.

**Recent Advancements (2020-2023)**

1. **Connected Worker Solutions**: AI-powered connected worker solutions emerged, enabling manufacturers to digitize and optimize frontline processes, including autonomous maintenance, quality, safety, and assembly.
2. **Generative AI (GenAI)**: The introduction of GenAI assistants, like Augmentir's Augie, which uses enterprise-wide data to provide instant access to relevant information, closes skills gaps, and identifies opportunities for continuous improvement.
3. **AI-First Approach**: Companies like Augmentir pioneered an AI-first approach, designing platforms with AI capabilities in mind to support frontline workers.

**Current State and Future Directions (2024 and beyond)**

1. **Augmenting Human Workers**: AI is now being used to augment and directly support frontline workers, rather than replace them.
2. **Increased Focus on Workforce Optimization**: AI-powered solutions aim to optimize workforce development, training, and productivity, addressing the manufacturing workforce crisis.
3. **Predictions and Future Developments**: The future of AI in manufacturing is expected to involve measuring signals to detect actual engagement of industrial workers and deriving useful insights to enhance HR and manufacturing processes.

**Key Statistics and Trends**

1. **86% of manufacturing executives** believe AI-based factory solutions will drive competitiveness in the next five years (Deloitte).
2. **1.7 Petabytes** of connected machine data is collected yearly, which can be used to optimize operations and frontline work processes.
3. **Generative AI assistants** can enhance operational efficiency, problem-solving, and decision-making for frontline industrial workers.

The evolution of AI in manufacturing has transformed from a focus on automation and replacement of human workers to augmenting and supporting frontline workers. The current state of AI adoption focuses on optimizing workforce development, training, and productivity, with future directions expected to involve measuring worker engagement and deriving useful insights.

[8] Title: Adopting AI in manufacturing at speed and scale | McKinsey
Link: https://www.mckinsey.org/capabilities/operations/our-insights/adopting-ai-at-speed-and-scale-the-4ir-push-to-stay-competitive
Refined Content: Here is the extracted and synthesized information relevant to the research topic:

**Adoption of AI in Manufacturing: Evolution over the Past Decade**

The adoption of AI in manufacturing has undergone significant evolution over the past decade, particularly among leading companies, known as Lighthouses, that are part of the Global Lighthouse Network. These companies have made substantial progress in implementing AI at scale, driven by advancements in machine intelligence technologies.

**Key Developments:**

1. **Maturity of AI**: AI has reached unprecedented levels of maturity, enabling machines to perform complex tasks in the cyber-physical world of production.
2. **Scaling Impact**: Leading companies are redefining the concept of a pilot by using entire factories as pilots for network-wide deployment at scale.
3. **Gen AI**: Generative AI (gen AI) has emerged as a significant development, enabling use of exceptionally large neural nets that can learn abstract patterns.
4. **Increased Adoption**: AI-based use cases make up over 60% of the use cases presented by new Lighthouse applicants, up from just 11% in 2019.

**Changes in Adoption over the Past Decade:**

1. **Early Use Cases**: In 2018, cutting-edge use cases focused on localized applications of advanced analytics and autonomous vehicles.
2. **Rapid Implementation**: Today, Lighthouses can implement use cases more rapidly, with 75% able to deploy a new advanced use case in under six months, and 30% in less than three months.
3. **Scaling Slump**: Companies are overcoming the scaling slump, achieving network-level impact, and setting standards for industries.

**Strategic Responses**:

Manufacturers must consider three types of strategic responses:

1. **Innovate**: Take a risk on and prove the next big thing at the factory level.
2. **Accelerate**: Focus on network-level impact, changing the landscape for an entire industry.
3. **Follow Fast**: Embrace the playbook already written by innovators and accelerators, capturing value while skipping the costs and tribulations of the learning curve.

Overall, the adoption of AI in manufacturing has evolved significantly over the past decade, with leading companies making rapid progress in implementing AI at scale, driving impact, and setting standards for industries.

[9] Title: Study reveals high AI adoption in manufacturing sector
Link: https://www.cohnreznick.com/insights/manufacturing-checkup-artificial-intelligence
Refined Content: Here's the extracted and synthesized information relevant to the research topic:

**High AI Adoption in Manufacturing Sector**

* A recent study by CohnReznick, titled the Manufacturing Checkup, reveals that 92% of manufacturers are very familiar with their company's use of artificial intelligence (AI), while only 8% are somewhat familiar.
* The study found that **three-fourths of manufacturers are currently investing in and applying AI**, with most functions being AI priorities for a majority of firms.
* **64% of manufacturers** cited customer growth as a driver for their willingness to consider using AI, followed by improved performance (51%), increased productivity (50%), and competitive advantage (36%).

**AI Usage and Priorities**

* Manufacturers are using or considering AI for various activities, including:
+ Analyzing transportation performance for logistics (57%)
+ Analyzing fraud reports for finance (53%)
+ Analyzing production performance for production and warehouses (52%)
* The top concerns for manufacturers when implementing AI are:
+ Cybersecurity and privacy (60%)
+ Cost (46%)
+ Employee concerns about AI (42%)

**AI Impact and Investment**

* Most manufacturers report a medium or high impact of AI on their businesses.
* **Over the next three years**, manufacturers expect to invest significantly in AI, with many making significant investments in AI for different functions.

**Key Findings and Recommendations**

* The study suggests that manufacturers should develop detailed plans for what they hope to accomplish with AI and the expected returns on investment.
* Companies should identify and resolve AI support gaps and establish policies and practices to minimize concerns about AI's unintended consequences.
* CohnReznick has worked with manufacturers to develop and implement AI governance structures and deploy processes to achieve AI objectives.

**Methodology**

* The research study was conducted by The MPI Group, an independent research firm, and was fielded in October 2024.

STEP 3: Iterative Refinement - Addressing Information Gaps

One of the most powerful aspects of our research pipeline is its ability to identify information gaps and adaptively refine the research process. Rather than relying solely on initial queries, the system:

Evaluates the completeness of currently gathered information
Identifies specific knowledge gaps related to the research topic
Generates targeted follow-up queries to fill those gaps
Iteratively expands the research until sufficient information is obtained

Disclaimer: This step involves multiple LLM runs processing long web texts, so we remind the user to be mindful about the resource management as defined at the beginning.

This iterative approach mimics how expert researchers work - continuously assessing what's known, what's missing, and how to fill those gaps systematically. Let's examine how this process works:

[ ]

================================================


Evaluation:

 ### Analysis of Search Results

#### Key Findings:
1. **Key Applications of AI in Manufacturing:**
   - **Predictive Maintenance**: Commonly mentioned across multiple sources, highlighting its importance in reducing downtime and maintenance costs.
   - **Quality Control**: AI-powered computer vision systems are widely used for defect detection and ensuring product quality.
   - **Supply Chain Optimization**: AI helps in demand forecasting, inventory management, and logistics.
   - **Intelligent Automation**: Combines software and robotics to automate complex tasks.
   - **Digital Twins**: Virtual replicas of physical systems for simulation and optimization.
   - **Generative Design**: AI algorithms generate multiple design options.
   - **Edge Analytics**: Real-time data processing at the edge of the network.
   - **Workforce Management**: AI aids in workforce planning and training.

2. **Benefits of AI in Manufacturing:**
   - **Cost Reduction**: Through optimized processes and reduced downtime.
   - **Improved Efficiency**: Automation and data-driven decision-making.
   - **Enhanced Safety**: AI-powered systems handle hazardous tasks.
   - **Sustainability**: Optimized resource use and reduced waste.
   - **Customization**: Mass customization of products.

3. **Challenges and Concerns:**
   - **Data Quality and Availability**: High-quality data is essential for AI effectiveness.
   - **Operational Risks**: AI models can lack precision in some applications.
   - **Skills Shortages**: Lack of professionals with AI expertise.
   - **Cybersecurity**: Increased digital connectivity brings new security risks.
   - **Cultural Resistance**: Employee concerns about job security and AI integration.

4. **Evolution of AI in Manufacturing:**
   - **Early Adoption (1960s-2019)**: Focus on automation and machine vision.
   - **Recent Advancements (2020-2023)**: Connected worker solutions, generative AI, and AI-first platforms.
   - **Current State (2024 and beyond)**: Augmenting human workers, workforce optimization, and measuring worker engagement.

5. **High AI Adoption Rates:**
   - **92% of manufacturers** are familiar with AI.
   - **75% are currently investing in AI**.
   - **64% cite customer growth** as a driver for AI adoption.

### Information Gaps:
1. **Detailed Case Studies:**
   - While there are examples of companies using AI, more detailed case studies with specific metrics and outcomes would provide a deeper understanding of the impact of AI in different manufacturing contexts.

2. **Regulatory and Ethical Considerations:**
   - The search results mention ethical concerns but lack detailed information on regulatory frameworks and ethical guidelines specific to AI in manufacturing.

3. **Long-Term Impact:**
   - There is limited information on the long-term impact of AI on the manufacturing industry, including potential job displacement, economic effects, and societal changes.

4. **Regional Differences:**
   - The search results do not provide a comparative analysis of AI adoption and impact across different regions or countries.

5. **Technological Barriers:**
   - More information on the specific technological barriers to AI adoption in manufacturing, such as integration with existing systems and interoperability issues, would be valuable.

### Targeted Follow-Up Queries:
1. **Detailed Case Studies:**
   - "Detailed case studies of AI implementation in manufacturing with specific metrics and outcomes"
   - "Examples of successful AI projects in manufacturing with long-term impact analysis"

2. **Regulatory and Ethical Considerations:**
   - "Regulatory frameworks for AI in manufacturing"
   - "Ethical guidelines for AI use in manufacturing"

3. **Long-Term Impact:**
   - "Long-term economic and societal impacts of AI in manufacturing"
   - "Job displacement and workforce transformation due to AI in manufacturing"

4. **Regional Differences:**
   - "Comparative analysis of AI adoption in manufacturing across different regions"
   - "Regional policies and initiatives supporting AI in manufacturing"

5. **Technological Barriers:**
   - "Technological barriers to AI adoption in manufacturing"
   - "Best practices for integrating AI with existing manufacturing systems"

### Conclusion:
While the current search results provide a comprehensive overview of the key applications, benefits, and challenges of AI in manufacturing, there are specific areas that require further exploration to fill the identified information gaps. Conducting follow-up research using the targeted queries will provide a more holistic understanding of the impact of AI on the manufacturing industry.
================================================


Additional queries from evaluation parser: ['Detailed case studies of AI implementation in manufacturing with specific metrics and outcomes', 'Examples of successful AI projects in manufacturing with long-term impact analysis']


================================================


Perform Tavily search with query: Detailed case studies of AI implementation in manufacturing with specific metrics and outcomes
Perform Tavily search with query: Examples of successful AI projects in manufacturing with long-term impact analysis
Tavily Responded with 5 results (Tavily returning None will be ignored for summarization)
Summarizing content asynchronously using the LLM
Summarizing content asynchronously using the LLM
Summarizing content asynchronously using the LLM
Summarizing content asynchronously using the LLM
Summarizing content asynchronously using the LLM
Tavily Responded with 5 results (Tavily returning None will be ignored for summarization)
Summarizing content asynchronously using the LLM
Summarizing content asynchronously using the LLM
Summarizing content asynchronously using the LLM
Summarizing content asynchronously using the LLM
Search complete, found 7 results after deduplication
================================================


Evaluation:

 ### Analysis of Search Results

The search results provide a comprehensive overview of the impact of artificial intelligence (AI) on the manufacturing industry. The information covers key applications, evolution over the past decade, detailed case studies, and long-term impact analysis. However, there are a few specific information gaps that need to be addressed to ensure a complete and well-rounded research report.

### Key Findings from Search Results

1. **Key Applications of AI in Manufacturing:**
   - Predictive Maintenance
   - Quality Control and Inspection
   - Supply Chain Optimization
   - Intelligent Automation
   - Digital Twins
   - Generative Design
   - Edge Analytics
   - Workforce Management
   - Energy Management

2. **Evolution of AI in Manufacturing Over the Past Decade:**
   - Early adoption focused on automation and robotics.
   - Recent advancements include connected worker solutions, generative AI, and AI-first approaches.
   - Leading companies (Lighthouses) have made significant progress in scaling AI at the factory level and network-wide.

3. **Detailed Case Studies:**
   - Siemens: Reduced downtime and maintenance costs through predictive maintenance.
   - General Electric (GE): Improved diagnostics and patient care with AI.
   - Toyota: Enhanced production efficiency and reduced defects.
   - Boeing: Increased manufacturing efficiency and product consistency.
   - Intel: Boosted semiconductor output and reduced waste.
   - Nissan: Improved assembly quality and production efficiency.
   - Harley-Davidson: Enhanced customer satisfaction and market agility.
   - ABB: Increased production efficiency and reduced energy consumption.
   - LG Electronics: Improved production efficiency and environmental sustainability.
   - Honda: Enhanced production flexibility and reduced environmental impact.
   - BASF: Higher yields and lower waste in chemical production.
   - Samsung: Increased production efficiency and product consistency.
   - Volvo: Improved production efficiency and reduced environmental impact.
   - Caterpillar: Enhanced machinery quality and durability.
   - Philips: Maintained high standards and achieved sustainability goals.

4. **Long-term Impact Analysis:**
   - Increased operational efficiency
   - Improved quality control
   - Enhanced supply chain management
   - Cost savings
   - Increased competitiveness
   - Sustainability and resilience

### Information Gaps

1. **Regulatory and Ethical Considerations:**
   - The search results do not provide detailed information on the regulatory and ethical considerations surrounding the implementation of AI in manufacturing. This includes data privacy, job displacement, and ethical use of AI.

2. **Challenges and Barriers to AI Adoption:**
   - While some challenges are mentioned, such as data quality and cybersecurity, a more comprehensive list of barriers to AI adoption in manufacturing is needed. This should include issues like initial investment costs, resistance to change, and the need for specialized skills.

3. **Impact on Workforce:**
   - The impact of AI on the manufacturing workforce, including job displacement, reskilling, and upskilling, is not thoroughly covered. More detailed information on how companies are addressing these issues would be beneficial.

4. **Case Studies from Smaller Manufacturers:**
   - Most case studies focus on large, well-known companies. Including examples from smaller and medium-sized manufacturers (SMMs) would provide a more balanced view of AI adoption across the industry.

5. **Long-term Sustainability and Environmental Impact:**
   - While some case studies mention sustainability, a more detailed analysis of the long-term environmental impact of AI in manufacturing is needed. This should include energy consumption, waste reduction, and carbon footprint.

### Targeted Follow-up Queries

1. **Regulatory and Ethical Considerations:**
   - "What are the key regulatory and ethical considerations for implementing AI in manufacturing?"
   - "How are manufacturers addressing data privacy and ethical use of AI in their operations?"

2. **Challenges and Barriers to AI Adoption:**
   - "What are the main challenges and barriers to AI adoption in manufacturing, and how are companies overcoming them?"
   - "What are the initial investment costs and return on investment (ROI) for AI projects in manufacturing?"

3. **Impact on Workforce:**
   - "How is the adoption of AI affecting the manufacturing workforce, and what strategies are companies using to reskill and upskill their employees?"
   - "What are the long-term implications of AI on job displacement in the manufacturing industry?"

4. **Case Studies from Smaller Manufacturers:**
   - "Can you provide examples of successful AI projects in small and medium-sized manufacturing companies?"
   - "What are the unique challenges and benefits of AI adoption for smaller manufacturers?"

5. **Long-term Sustainability and Environmental Impact:**
   - "What is the long-term environmental impact of AI in manufacturing, and how are companies measuring and reducing their carbon footprint?"
   - "How are manufacturers using AI to achieve sustainability goals and reduce energy consumption?"

### Conclusion

The current search results provide a solid foundation for understanding the impact of AI on the manufacturing industry. However, to ensure a comprehensive and well-rounded research report, the identified information gaps need to be addressed through targeted follow-up queries. This will provide a more holistic view of the benefits, challenges, and long-term implications of AI in manufacturing.
================================================


Additional queries from evaluation parser: ['What are the key regulatory and ethical considerations for implementing AI in manufacturing?', 'How are manufacturers addressing data privacy and ethical use of AI in their operations?']


================================================


Perform Tavily search with query: What are the key regulatory and ethical considerations for implementing AI in manufacturing?
Perform Tavily search with query: How are manufacturers addressing data privacy and ethical use of AI in their operations?
Tavily Responded with 5 results (Tavily returning None will be ignored for summarization)
Summarizing content asynchronously using the LLM
Summarizing content asynchronously using the LLM
Summarizing content asynchronously using the LLM
Summarizing content asynchronously using the LLM
Summarizing content asynchronously using the LLM
Tavily Responded with 5 results (Tavily returning None will be ignored for summarization)
Summarizing content asynchronously using the LLM
Summarizing content asynchronously using the LLM
Summarizing content asynchronously using the LLM
Summarizing content asynchronously using the LLM
Summarizing content asynchronously using the LLM
Search complete, found 10 results after deduplication

Below is the comprehensive collection of all queries executed and results gathered throughout our research process. This dataset represents:

Initial queries generated from the research topic
Follow-up queries identified through gap analysis
All retrieved content after preprocessing and relevance filtering
Source metadata for proper attribution

This consolidated view demonstrates the breadth and depth of information our system has gathered, providing the foundation for our final research synthesis:

[ ]

['What are the key applications of AI in the manufacturing industry?',
, 'How has the adoption of AI in manufacturing evolved over the past decade?',
, 'Detailed case studies of AI implementation in manufacturing with specific metrics and outcomes',
, 'Examples of successful AI projects in manufacturing with long-term impact analysis',
, 'What are the key regulatory and ethical considerations for implementing AI in manufacturing?',
, 'How are manufacturers addressing data privacy and ethical use of AI in their operations?']

[ ]

First 10000 characters of 26 results:

Artificial intelligence (AI) is transforming the manufacturing landscape by enhancing efficiency, innovation, and productivity. The five main AI applications in manufacturing include:

**AI Technologies Used in Manufacturing**

Some key AI technologies used in manufacturing include:

**Real-World Examples of AI in Manufacturing**

**Benefits of AI in Manufacturing**

**Key Applications of AI in Manufacturing:**

**Benefits of AI in Manufacturing:**

* Reduced conversion costs by up to 20%
* Improved workforce productivity
* Enhanced troubleshooting processes
* Increased efficiency and reduced costs
* Improved product quality and reduced waste

**Companies Using AI in Manufacturing:**

* Siemens
* Microsoft (Factory Operations Agent)
* Nvidia
* Figure AI
* Authentise (integrating AI into core manufacturing workflows)

**Trends and Future Directions:**

Based on the provided content, the key applications of AI in the manufacturing industry are:

**Transformative Benefits of AI in Manufacturing**

The integration of AI in manufacturing offers several benefits, including:

**Challenges and Lessons Learned**

The content also highlights the challenges of AI implementation in manufacturing, including:

**Key Applications of AI in the Manufacturing Industry:**

...

Last 10000 characters of 26 results:

ment, focusing on privacy, fairness, and transparency, and actively addresses biases.

### Collaboration for Ethical AI Development

Developing ethical AI requires collaboration among various stakeholders:

* **Academics**: Research and develop theories and statistics to guide AI ethics.
* **Governments**: Facilitate AI ethics through regulations and public outreach.
* **Intergovernmental Entities**: Raise global awareness and draft international agreements on AI ethics.
* **Non-Profit Organizations**: Advocate for diverse representation and create guidelines.

### Best Practices for Manufacturers

To address data privacy and ethical use of AI, manufacturers can:

1. **Establish AI ethics boards** to ensure accountability and transparency.
2. **Implement robust data protection measures** to respect individual privacy.
3. **Invest in bias detection and mitigation** to eliminate unfair outcomes.
4. **Prioritize human-centric design**, focusing on AI that augments rather than replaces human capabilities.
5. **Consider the environmental impact** of AI technologies and strive for sustainable practices.

By adopting these best practices and collaborating with various stakeholders, manufacturers can ensure that their use of AI is both responsible and beneficial to society.

[24] Title: AI Safety and Ethical Considerations | SpringerLink
Link: https://link.springer.com/chapter/10.1007/978-3-031-86091-1_6
Refined Content: **Relevant Information for Research Topic: How are manufacturers addressing data privacy and ethical use of AI in their operations?**

**Key Findings:**

1. **Adoption of AI Ethics Policies:** As of 2021, 89% of industrial manufacturers have reported the adoption of AI ethics policies, indicating a significant effort to address ethical considerations in AI deployment.
2. **Ethical Challenges:** Manufacturers face key ethical challenges, including:
* Algorithmic biases
* Cybersecurity threats
* Job displacement
* Compliance with global regulations
3. **Strategies for Ethical AI Implementation:** To address these challenges, manufacturers are focusing on:
* Ensuring transparency
* Interpretability
* Human oversight
* Continuous monitoring
4. **Governance Framework:** A governance framework for responsible AI is necessary, built on the pillars of:
* People
* Processes
* Technology
5. **Regulatory Variations:** Manufacturers must comply with diverse legal landscapes, including:
* EU's AI Act
* China's stringent compliance requirements
6. **Actionable Insights:** To foster responsible AI use, manufacturers should:
* Design fairness-aware algorithms
* Align corporate policies with international standards

**Specific Data and Terminology:**

1. **Algorithmic Fairness:** The absence of discrimination or bias in automated decision-making systems.
2. **Human Oversight:** Human monitoring and intervention in AI-driven processes to ensure ethical and responsible operation.
3. **Interpretability:** The degree to which a human can understand the cause of a decision or prediction made by an AI model.
4. **Responsible AI:** The practice of designing, developing, and deploying AI systems in a manner that empowers people and businesses and fairly impacts customers and society.
5. **Transparency:** The clarity and openness about how AI systems operate and make decisions.

**References:**

1. **Statista (2021):** Worldwide artificial intelligence implementation ethics policies.
2. **Copper Digital:** Exploring ethical AI decision making in manufacturing.
3. **Ryan et al. (2021):** Research and practice of AI ethics: A case study approach.
4. **Princeton Dialogues on AI and Ethics:** Case studies on AI ethics.
5. **Brookings (2023):** The EU and U.S. diverge on AI regulation: A transatlantic comparison and steps to alignment.

[25] Title: How Businesses Can Ethically Embrace Artificial Intelligence - Forbes
Link: https://www.forbes.com/councils/forbesbusinesscouncil/2023/05/12/how-businesses-can-ethically-embrace-artificial-intelligence/
Refined Content: Here is the extracted and synthesized information relevant to the research topic:

**Addressing Data Privacy and Ethical Use of AI in Operations**

Manufacturers are addressing data privacy and ethical use of AI in their operations by implementing guidelines and regulations to prevent misuse. Some of the measures being taken include:

1. **Disclosing information about AI systems**: Companies are disclosing information about their AI systems to identify potential risks and ensure accountability.
2. **Establishing guidelines for acceptable data types and collection methods**: Businesses are creating guidelines that outline acceptable data types and personal information collection methods to ensure data security and prevent misuse.
3. **Ensuring data security**: Companies are taking steps to ensure data security and prevent unauthorized access or misuse of data.
4. **Creating laws and regulations**: Governments are being lobbied to introduce laws and regulations to safeguard personal data and establish independent bodies to monitor AI's use and investigate potential misuse.

**Ethical Concerns and Potential Risks**

Some of the ethical concerns raised about AI include:

1. **Plagiarism and propaganda**: AI can be used to create false information or propaganda to influence public opinion.
2. **Job loss**: AI can automate tasks, potentially replacing human jobs.
3. **Decline in creativity**: AI may rely on existing data, limiting its ability to provide innovative solutions.
4. **Data privacy**: AI systems can collect and use personal data, raising concerns about data protection and security.

**Best Practices for Ethical AI Use**

To address these concerns, manufacturers are:

1. **Implementing restrictions**: Companies are implementing restrictions to maintain the well-meant intention of AI use.
2. **Lobbying for safeguards**: Business leaders are lobbying for safeguards at a higher level within their governments.
3. **Adhering to guidelines**: Companies are adhering to guidelines that prohibit misuse, outline acceptable data types and personal information collection methods, and ensure data security.

By taking these steps, manufacturers can ensure the safe and ethical integration of AI in their operations, addressing concerns around data privacy and ethical use of AI.

[26] Title: Top 10 companies with ethical AI practices
Link: https://aimagazine.com/ai-strategy/top-10-companies-with-ethical-ai-practices
Refined Content: Here is the extracted and synthesized information relevant to the research topic:

**Companies Addressing Data Privacy and Ethical Use of AI:**

1. **Accenture**:
- Established a generative AI and LLM Centre of Excellence (CoE) with 1600 employees.
- Trained 40,000 employees in AI to support the CoE.
- Aims to design and deploy responsible AI solutions that are ethical, transparent, and trustworthy.

2. **Deloitte**:
- Offers an AI Risk Management Framework for effective operating models and crisis management.
- Provides services to help organizations govern AI responsibly.
- Conducts roundtable workshops and training for senior leaders on AI ethics.

3. **Google DeepMind**:
- Merged with Google Brain to tackle AI research and products that improve human lives.
- Achieved scientific breakthroughs, such as AlphaFold for predicting protein structures.

4. **TCS (Tata Consultancy Services)**:
- Uses the Machine First Delivery Model (MFDM) to address ethics in AI services and solutions.
- Announced plans to train 25,000 engineers to be certified on Microsoft Azure Open AI.

5. **Apple**:
- Joined the Partnership on AI research group to demonstrate its commitment to AI ethics.
- Explores AI to solve real-world problems through deep learning, reinforcement learning, and research.

6. **AWS (Amazon Web Services)**:
- Committed to developing fair and accurate AI/ML services.
- Provides tools and guidance for building AI applications responsibly.
- Offers education and training through programs like the AWS Machine Learning University.

7. **IBM**:
- Aims to help people and organizations adopt AI responsibly via ethical principles.
- Pillars of ethical AI: explainability, fairness, robustness, transparency, and privacy.
- Established a Center of Excellence (CoE) for Generative AI.

8. **Meta**:
- Grounds its work in five pillars of responsibility: privacy and security, fairness and inclusion, robustness and safety, transparency and control, and accountability and governance.
- Addresses AI fairness through research and diverse datasets.

9. **Microsoft**:
- Created the Microsoft Responsible AI Standard principles to guide AI system design, build, and testing.
- Collaborates with researchers and academics to advance responsible AI practices.

10. **Google AI**:
- Works towards eliminating biases in AI teams through human-centered design and data examination.
- Will not pursue AI applications in technologies like weapons or surveillance that violate human rights.

**Key Terminology and Context:**

* **Ethical AI**: Prioritizing data protection and preventing data bias.
* **Responsible AI**: Ensuring AI systems are trustworthy, transparent, and fair.
* **AI Risk Management Framework**: A structure for effective operating models and crisis management.
* **Machine First Delivery Model (MFDM)**: TCS's approach to addressing ethics in AI services and solutions.
* **Center of Excellence (CoE)**: A centralized unit for expertise and innovation, e.g., Accenture's generative AI and LLM CoE.

**Specific Data:**

* 35% of global consumers trust how AI is being implemented by organizations (Accenture).
* 77% of consumers think organizations must be held accountable for AI misuse (Accenture).
* 25,000 engineers to be certified on Microsoft Azure Open AI by TCS.
* 1600 employees in Accenture's generative AI and LLM Centre of Excellence.
* 40,000 employees trained in AI by Accenture.

STEP 4: Content Filtering and Prioritization - Optimizing Information Quality

After gathering comprehensive information through our iterative search process, we face a new challenge: not all content is equally valuable or relevant. This step addresses the critical task of quality control by:

Evaluating each source for relevance, credibility, and information value
Prioritizing the most pertinent content while filtering out noise
Organizing information to create an optimal foundation for synthesis

This filtering process improves the quality of our final research output by ensuring we synthesize only the most valuable information. The system acts as a discerning research assistant, making informed judgments about which sources deserve attention:

[ ]

Note: In rare cases we saw none results were kept after LLM filtering, where rerunning the cell would typically resolve the issue.

[ ]

Deduplication complete, kept 26 results
filter response: Based on the research topic "The impact of artificial intelligence on the manufacturing industry," I have evaluated each search result for relevance, accuracy, and information value. Here is the list of source numbers with the rank of relevance:

**Highly Relevant (1-5)**

1. [5] Title: How is AI being used in Manufacturing | IBM
2. [6] Title: Artificial Intelligence in manufacturing: State of the art ...
3. [4] Title: Manufacturing AI: Top 15 tools & 13 real-life use cases ['25] - AIMultiple
4. [14] Title: AI in Manufacturing: 12 key Use Cases, Examples, and more - MultiQoS
5. [16] Title: Artificial Intelligence in Manufacturing: Real World Success Stories ...

**Relevant (6-10)**

6. [1] Title: How Is AI Used in Manufacturing: Examples, Use Cases, and Benefits
7. [2] Title: The Rise of AI in Manufacturing: 2025 Trends, Tools & Real-World Impact
8. [3] Title: AI in Manufacturing: The Smart Revolution in Industry
9. [7] Title: The Evolution of AI in Manufacturing - Augmentir
10. [8] Title: Adopting AI in manufacturing at speed and scale | McKinsey

**Somewhat Relevant (11-15)**

11. [9] Title: Study reveals high AI adoption in manufacturing sector
12. [10] Title: How can AI be Used in Manufacturing? [15 Case Studies] [2025]
13. [11] Title: Eight AI Case Studies Demonstrate the Potential of AI in Manufacturing
14. [12] Title: AI in the Real World: 4 Case Studies of Success in Industrial Manufacturing
15. [15] Title: AI Transformation Chronicles: AI in Manufacturing Industry

**Not Relevant (16-25)**

16. [17] Title: Three Key Considerations for Companies Implementing Ethical AI
17. [18] Title: (PDF) Ethical Considerations in the Deployment and Regulation of ...
18. [19] Title: Ethical Considerations and Responsible Implementation of AI - Verbat
19. [20] Title: How Ethics, Regulations And Guidelines Can Shape Responsible AI - Forbes
20. [21] Title: 5 Ethical Considerations of AI in Business - Harvard Business School Online
21. [22] Title: AI's Data Dilemma: Privacy, Regulation, and the Future of Ethical AI
22. [23] Title: 13 Ethical AI Companies Leading the Way in Responsible Innovation
23. [24] Title: AI Safety and Ethical Considerations | SpringerLink
24. [25] Title: How Businesses Can Ethically Embrace Artificial Intelligence - Forbes
25. [26] Title: Top 10 companies with ethical AI practices

The top 5 sources are highly relevant to the research topic, providing in-depth information on the impact of AI on the manufacturing industry. The next 5 sources are relevant, offering insights into the use of AI in manufacturing, its benefits, and challenges. The remaining sources are somewhat relevant or not relevant, focusing on ethical considerations, regulations, and guidelines for AI implementation, which are not directly related to the research topic.
sources ranked by relevance [5, 6, 4, 14, 16, 1, 2, 3, 7, 8, 9, 10, 11, 12, 15] (we will keep maximum of 10 sources, as defined by the user)
LLM Filtering complete, kept 10 results

STEP 5: Research Synthesis - Generating the Comprehensive Final Report

We've now reached the culmination of our research process. After carefully gathering, refining, and filtering information through multiple stages, we're ready to synthesize everything into a cohesive, publication-quality report. This final step:

Integrates information from all selected sources into a unified narrative
Structures content logically with clear sections and progression of ideas
Provides proper citations for all factual claims and insights
Balances breadth and depth to create a thorough yet readable analysis
Preserves nuance and context from the original sources

The synthesis process uses our specialized answer model, which excels at long-form, coherent content generation while maintaining factual accuracy. Let's generate our final research report:

[ ]

Exporting and Sharing Research Results

The final step in our research pipeline is to format and export the results for sharing, preservation, and presentation (e.g., html, pdf, slides, etc). Enjoy!

[ ]

Research report saved as research_report.html

Limitations and Considerations

While the Deep Search approach offers powerful research capabilities, it's important to understand its limitations and constraints:

Information Constraints

Recency Gap: Search-based research is limited by the indexing latency of search engines. Very recent events or publications may not be captured.
Access Limitations: Some valuable information sources may be behind paywalls or otherwise inaccessible to the search system.
Domain Specificity: Highly specialized or technical domains may have limited indexing in general search engines.

Processing Considerations

Query Dependency: The quality of results is heavily influenced by the initial and follow-up queries generated. Poorly formulated queries can lead to information gaps.
Source Reliability: While the system attempts to prioritize credible sources, it cannot perfectly assess the accuracy or bias of all content.
Content Extraction Challenges: Complex formats like tables, charts, or specialized notation may not be accurately captured in the content processing stage.

Resource Requirements

API Costs: The system makes multiple calls to search and LLM APIs, which can incur significant costs for extensive research topics.
Time Efficiency: The iterative, multi-step nature of the process means it takes longer than simple RAG or direct LLM approaches.
Model Dependencies: The quality of outputs depends on having access to capable LLM models for different stages of the pipeline.

Ethical Considerations

Source Attribution: While the system attempts to provide proper citations, it may not always perfectly attribute information to original creators.
Content Bias: The system may inadvertently amplify biases present in the indexed content or search ranking algorithms.
Privacy Implications: Research on certain topics may involve information with privacy sensitivities.

Understanding these limitations helps set appropriate expectations and identify situations where this approach should be complemented with other research methodologies. For critical research needs, human review and validation remain essential.

Acknowledgements

This cookbook relies on several key technologies and services that make advanced research capabilities possible:

Tavily Search API: Our cookbook leverages the Tavily API for efficient, high-quality web search functionality. Tavily provides comprehensive search results with raw content access, enabling our system to perform detailed content analysis. We are grateful to the Tavily team for providing this essential capability that forms the foundation of our information gathering process.

Together AI: The LLM-powered components of our system are built using Together AI's API, which provides access to state-of-the-art language models optimized for different aspects of the research pipeline. Together AI's infrastructure enables the sophisticated analysis, planning, and synthesis capabilities that drive our research system.

Open Source Community: This work builds upon numerous open-source libraries, tools, and research that have advanced the fields of natural language processing, information retrieval, and AI-assisted research. We acknowledge the broader community whose ongoing contributions make projects like this possible.

If you use this cookbook in your own work or research, please consider acknowledging both Tavily and Together AI for their enabling technologies.

Open source developers across the tech landscape have launched several meaningful attempts to recreate the capabilities of OpenAI's Deep Researcher. Some notable ones are as follows: