The influenza A virus RNA-dependent RNA polymerase complex consists in three subunits, PB2, PB1 and PA, that perform transcription and replication of the viral genome through very distinct mechanisms. Biochemical and structural studies have revealed that the polymerase can adopt multiple conformations and form oligomers. However so far it remained unclear whether the available oligomeric crystal structures represent a functional state of the polymerase. Here we gained new insights into this question, by investigating the incompatibility between non-cognate subunits of influenza polymerase brought together through genetic reassortment. We observed that a 7:1 reassortant virus whose PB2 segment derives from the A/WSN/33 (WSN) virus in an otherwise A/PR/8/34 (PR8) backbone is attenuated, despite a 97% identity between the PR8-PB2 and WSN-PB2 proteins. Independent serial passages led to the selection of phenotypic revertants bearing distinct second-site mutations on PA, PB1 and/or PB2. The constellation of mutations present on one revertant virus was studied extensively using reverse genetics and cell-based reconstitution of the viral polymerase. The PA-E349K mutation appeared to play a major role in correcting the initial defect in replication (cRNA -> vRNA) of the PR8xWSN-PB2 reassortant. Strikingly the PA-E349K mutation, and also the PB2-G74R and PB1-K577G mutations present on other revertants, are located at a dimerization interface of the polymerase. All three restore wild-type-like polymerase activity in a minigenome assay while decreasing the level of polymerase dimerization. Overall, our data show that the polymerase subunits co-evolve to ensure not only optimal inter-subunit interactions within the heterotrimer, but also proper levels of dimerization of the heterotrimer which appears to be essential for efficient viral RNA replication. Our findings point to influenza polymerase dimerization as a feature that is controlled by a complex interplay of genetic determinants, can restrict genetic reassortment, and could become a target for antiviral drug development.