Is 4th and Pine a sketchy area of Seattle? I'd be working downtown part time til about 10pm and taking the?

I'd be working part time and taking the bus to and from the area. I'd be getting off work around 10 at night. The bus lets me off at westlake monorail, i walk a block and it's on Pike St, a couple blocks from the Convention Center. I live in the U District and I'm a 21 year old guy, so walking alone at night isn't a huge deal, I just keep my head down and get where I'm going. But downtown may be different, I don't know because I'm new to the area. Should I be worried.