Task switching means waits and delays. Games do a lot of work to hide loading screens.
Also game audiences are narrowly scoped. You generally aren't designing for such a large age range, ability range, willing-ness to pay, device range, context of use range...