Example notebooks

This section contains practical examples and tutorials that demonstrate how to use Giskard Open Source for LLM testing and evaluation.

The notebooks cover various use cases and scenarios, from basic security testing to advanced business logic validation.

Detecting Security Vulnerabilities with Scan

IPCC Climate Change Report

Question Answering (LangChain, FAISS, OpenAI)

LLM Question Answering over the IPCC Climate Change Report
Google Q&A

Question Answering (LangChain, Qdrant, OpenAI)

LLM Question Answering with Langchain, Qdrant and OpenAI
2022 Winter Olympics Q&A

Question Answering (OpenAI)

LLM Question Answering over the 2022 Winter Olympics Wikipedia articles
Product Description

Description Generation (LangChain, OpenAI)

LLM product description from keywords
Newspaper Comment Generation

Description Generation (LangChain, OpenAI)

LLM Newspaper Comments Generation with LangChain and OpenAI
Documentation Q&A

Question Answering (LangChain, FAISS, OpenAI)

LLM Question Answering over the documentation with Langchain, FAISS and OpenAI

Detecting Business Failures with RAGET

IPCC Climate Change Report

RAGET Demo with LlamaIndex RAG

RAG Evaluation Toolkit on an IPCC Climate Agent
ECB Banking Supervision Report

RAGET Demo with LlamaIndex RAG

RAG Evaluation Toolkit on a Banking Supervisory Process Agent