Yes, your contacts need to use Signal if you want to communicate privately.
All messaging and calling is private. You will only see Signal contacts listed.
Use Signal for all your messaging. You can message your Signal contacts privately or use your mobile plan's SMS/MMS through the Signal interface.