Georgia was born in Bellingham, Washington; she graduated from Ballard High School in Seattle in 1956 and worked as a bookkeeper throughout her life. In 1964, she married Ronald Swanson and moved to Edmonds, Washington. Their son, Eric, was born in 1968. Georgia and Ron retired to Freeland on Whidbey Island in 1995. Ron passed away in 2000.

Georgia married Raymond Loe in 2004, and they settled in Greenbank, Whidbey Island, the following year. She enjoyed travel, gardening, rosemaling (Norwegian decorative painting), genealogy, and was a devoted Seattle Mariners fan from the team's first game.

She is survived by her son Eric Swanson, his wife Kristy, and their children Liam and Sadie; her stepchildren Karen and her husband Barrie Hutchinson; Cindy Loe; and Eric Loe, his wife Lisa, and their son Brady.