Yes. is capitalized because it is a proper noun referring to a governmental legislative body that includes the House of Representatives and Senate.
Examples of capitalizing the word include the U.S. Congress, Congress, etc.
What about congressional?
Congressional is not a proper noun naturally, so it should be lowercased unless used in an official event title such as the “Congressional Baseball Game.”