In recent years GE has actually been reducing the size of GE Capital and have e.g. sold off their mortage and banking divisions. GE first got into finance back in the 30s by lending money to businesses that wanted to buy GE products, and from my understanding they’ve been moving their finance focus back to that.
But five, ten years ago? Yeah, back then they were one of the biggest finance companies in the US.