Customize sidebar content

Where do I find the settings to customize sidebar content? I want to remove some information that is already entered by default.
Can I make the sidebar of the Blog page different from the sidebar of the shop r contact page?