Note: links are to my docs website which pulls its content from the repositories shared here.
Documentation Repositories, Index¶
I use Github as a notepad to share documentation, notes, and experiments.
Recently, I set up a website to house it:
A list of some of the repositories contained is here:
Large Language Models (LLMs)¶
Why I find LLMs deeply fascinating!
I've become deeply fascinated by large language models! For creatives with a passion for technology like me, they are the perfect tool. Using them effectively requires a blend of technical skills and creativity.
Since mid-2024, I’ve been exploring various use cases, particularly those focused on data discovery, analysis, and visualization—i.e., non-conversational applications. Additionally, I’m especially interested in finding efficient ways to organize and store outputs, as well as leveraging previous outputs to significantly enhance the relevance and quality of inferences. One project I am eager to explore in the near future using LLMs to mine structurable data sources for geopolitical analysis. This repository is called Israel GeoInsights and updates will appear once I have them
General¶
About This Repo
This repository shares configurations for custom LLM agents. Originally, this started as JSON configs for OpenAI's "custom GPTs" before I moved most of my assistants over to Hugging Face. These cover a variety of common LLM use cases and should be fairly easy to configure across different platforms.
Exploration, Research, Experiments¶
About This Repo
In the course of experimenting with various locally-deployed large language models, I'm developing my small collection of evaluation prompts which I've tailored to the specific kind of use cases I'm commonly exploring, particularly stack research and technical evaluations.
About This Repo
This repository contains occasionally updated LLM API pricing information intended to help answer the question of the comparative costs of using large language models via web UIs as compared to APIs. Notwithstanding some of the more expensive models recently released on API, most of my calculations show that using LLMs via API at consumer level of uses, is typically not significantly more expensive than the current prices for consumer subscriptions.
About This Repo
Some of what I think are my most interesting prompting experiments to date have consisted of asking large language models to explain various core concepts of LLM engineering - like inference, context management, and the mysteries of training data selection. Although the idea that LLMs are an inherently reliable source of information on LLMs is no more certain than their reliability on any subject, I have received some interesting nuggets of information which are collected here
LLM Professional Workflow: Notes, Scaffolds¶
LLM & Prompt Engineering Workflow
About This Repo
I'm extremely interested in the potential of large language models to serve as brainstorming and ideation partners for all kinds of creatives and knowledge economy professionals. To that end, I've spent some time thinking about the best manner to integrate the increasingly collaborative workflow between humans and AI in terms of structure. This repository contains some notes I've jotted down for scaffolds and mechanisms for organising prompts, system prompts, context snippets, and other AI-related data. Like the entire enterprise of trying to leverage these tools as productively and responsibly as possible, it's very much a work in progress.
LLM Knowledge Management Project
About This Repo
Most of my beliefs about AI are fairly standard and non controversial. I'm probably more optimistic than most about the potential of these tools to transform our work lives. The only contrarian position I hold, perhaps, is the idea that far more attention should be invested in the question of what to do about the outputs that are generated by AI workflows. Since I began using these tools professionally, I've been looking, mostly unsuccessfully, for tools that are purpose built for storing and organizing not only prompts, but also outputs. As the search hasn't been very fruitful, I've been developing my own solution. Some notes about their project are included in this repository.
Mapping: Resources, Community & Ecosystem¶
About This Repo
I started this repository at a time and it was just about possible to create a somewhat thorough list of the various prompt libraries that were being shared on Github and other sources. That is no longer the case. However, this repository continues to exist as a very partial selection of some of the prompt libraries that one can find scattered across various websites, but especially on Github.
About This Repo
This repository aims to gather together resources that I hope will be of interest to those interested in prompt engineering, an increasingly important field. This loosely organized repository gathers together things like books, podcasts, guides, and other subjects of interest to the prompt engineering community.
Mapping: Tools, Frameworks¶
Prompt Management, Prompt Engineering¶
About This Repo
This repository contains my public prompt library and is currently in a very incomplete state. However, my hope is that over time I will go back through the prompts I've recorded and share some of the more useful ones.
About This Repo
After spending almost a year having a great time learning about LLMs through various projects, in late 2024 I finally got around to beginning to create some content such as videos and blogs about my successes and failures trying to use this technology to date. Some of those notes are being published now on a website called the LLM Files. I created this repository to hold some more deterministic notes that I called the principles of prompting. As I gather together my notes from across various places, I hope to share some of what I consider to be the most foundational principles of good prompt engineering.
Data Analysis and Visualisation¶
About This Repo
This repository gathers together a few notes from various data analysis and visualization projects.
Writing & Thoughts¶
Notepads¶
Other Docs¶
Other Documentation & Publishing Projects¶
The LLM Files (Notes, Blogs)¶
The LLM Files is a blog I'm working on about prompt engineering and large language models. I hope to share both resources and thoughts about the techniques and use cases I'm discovering as I encounter and explore them.
Daniel Goes Prompting (Prompts & Outputs Repository)¶
When I began working with large language models more intensively in 2024, I began recording prompts and outputs to populate a system for managing these which I was building. As I gathered quite a large amount of both in my first tranche, I decided to share a segment of them through a website. The material shared is deliberately unedited and in first entry format. It's designed to reflect an imprint of sorts of the evolution of LLMs as their capabilities hopefully grow over time.
