Getting the CLI installed again was complete ass. Turns out I needed to install libssl-dev, but none of the error messages were even remotely helpful for figuring that out!