Throughout the brief but exciting history of computing, you could generally only throw a limited amount of compute at a problem. You had a problem, you had a program, the program ran, used some compute, and you got the result. Now, this wasn’t true for all problems - there were some optimization programs that you could run for any amount of steps, sure, but generally, that’s how things worked.
Aug 31, 2023·edited Aug 31, 2023Liked by Sergey Alexashenko
How do you think about this risks in this domain? If it's possible to get an AI Agent to answer the question about the stock price, then surely it's also possible to (a) ask the agent to hack a target system (b) attempt to set up a phishing/scamming operation, or (c) setup copies of itself (if you have weights access) on cloud VMs, which will recursively take the same action with the final goal of DDOS'ing a website, leading to exponential proliferation of agents.
These capabilities seem fairly hard to control, to say the least!
I argue that the most valuable problem is guaranteeing an unbiased solution, no matter the budget or time constraint. I don't believe it can be solved or guaranteed. It is a snapshot in time, and any historical problem solving completed can be reprogrammed/retrained or provided bad input at any moment, in any fashion. Dense individuals will continue to mistake speed for accuracy. Just like "safe and effective" at "warp speed".
How do you think about this risks in this domain? If it's possible to get an AI Agent to answer the question about the stock price, then surely it's also possible to (a) ask the agent to hack a target system (b) attempt to set up a phishing/scamming operation, or (c) setup copies of itself (if you have weights access) on cloud VMs, which will recursively take the same action with the final goal of DDOS'ing a website, leading to exponential proliferation of agents.
These capabilities seem fairly hard to control, to say the least!
AI cannot think and its not even close to it yet. We need a technology design breakthrough to leap to the next level of ASI or singularity
I argue that the most valuable problem is guaranteeing an unbiased solution, no matter the budget or time constraint. I don't believe it can be solved or guaranteed. It is a snapshot in time, and any historical problem solving completed can be reprogrammed/retrained or provided bad input at any moment, in any fashion. Dense individuals will continue to mistake speed for accuracy. Just like "safe and effective" at "warp speed".