The data shows a growing gap in Americans finding common ground with two groups compared to the other five options.