Rich Harang
@rich.harang.org
1.2K followers 817 following 625 posts
Using bad guys to catch math since 2010. Distinguished Security Architect (AI/ML) and AI Red Team at NVIDIA. He/him. Personal account etc; `from std_disclaimers import *` AI Security since it was ML Security.
![Screenshot of a Twitter post, text reads
[Dentist waiting room]
Me: [chanting] teeth, teeth-
Other patients: teeth, TEETH
Secretary: [pounding her clipboard] TEETH, TEETH, TEETH!](https://cdn.bsky.app/img/feed_thumbnail/plain/did:plc:xvzmaufbl63npctyzvtm7zem/bafkreihezqc46ipy66y6jbotj3wy6sz7isv754ah3ryjhptttnnmj6oovm)
![Screenshot of a code snippet:
```python
#!/usr/bin/env python3
import json,os,subprocess,sys
from urllib.request import Request,urlopen
for l in open(".env"):
k,_,v=l.strip().partition("=")
if k and not k.startswith("#"):os.environ[k]=v
U,M,K=os.environ["URL"],os.environ["MODEL"],os.environ["API_KEY"]
T=[{"type":"function","function":{"name":"bash","description":"Run bash command","parameters":{"type":"object","properties":{"cmd":{"type":"string"}},"required":["cmd"]}}}]
H=[{"role":"system","content":"You are an autonomous agent. Use the bash tool to accomplish tasks. Read files with `cat`. use `sed` to change specific text or view specific file lines. Use heredocs to write complete files."}]
def c():return json.load(urlopen(Request(f"{U}/chat/completions",json.dumps({"model":M,"messages":H,"tools":T,"tool_choice":"auto"}).encode(),{"Authorization":f"Bearer {K}","Content-Type":"application/json"})))["choices"][0]
H+=[{"role":"user","content":" ".join(sys.argv[1:])or "Create an improved version of the agent.py script; your first priorities are to ensure the script is more robust to errors, next should be to create persistent conversation history that can be loaded across sessions, and context management to avoid creating a conversation history too long for your context window. Finally identify additional capabilities that are required and develop a plan to implement them."}]
while 1:
x=c();m=x["message"];H+=[m]
if x["finish_reason"]=="tool_calls":
for t in m["tool_calls"]:
d=json.loads(t["function"]["arguments"])["cmd"];print(f"$ {d}");r=subprocess.run(d,shell=1,capture_output=1,text=1,timeout=30);o=(r.stdout+r.stderr).strip()or"(no output)";print(o+"\n");H+=[{"role":"tool","tool_call_id":t["id"],"content":o}]
else:
print(m["content"]);n=input("\nYou: ").strip()
if not n:break
H+=[{"role":"user","content":n}]
```](https://cdn.bsky.app/img/feed_thumbnail/plain/did:plc:xvzmaufbl63npctyzvtm7zem/bafkreiahg2vo5xvrsr4qo5bii5jsrmrzl6pc3qfa6uzb5pgjdsw7o4el4a)
![Screenshot of a gmail inbox showing approximately 20 email's of the form "[Person] has added you to a group conversation on Twitter!"](https://cdn.bsky.app/img/feed_thumbnail/plain/did:plc:xvzmaufbl63npctyzvtm7zem/bafkreifq3tkosus27yko3lfoczfsvljf3ot5lax3njm5nl7hottz2ngobi)
