Register With Each State Separately?

I plan to start an RIA business in CA.  I understand I need to register with the state each year, and there is a one time FINRA registration. 

If I have a few clients in other states, do I need to register in each of their states?  Or does it depend on the state?

Thanks.