The ductile behavior of olivine-rich rocks is critical to constrain thermal convection in the Earth's upper mantle. Classical olivine flow laws for dislocation or diffusion creep fail to explain the fast post-seismic surface displacements observed by GPS, which requires a much weaker lithosphere than predicted by classical laws. Here we compare the plasticity of olivine aggregates deformed experimentally at mantle pressures and temperatures to that of single crystals and demonstrate that, depending on conditions of stress and temperature, strain accommodated through grain-to-grain interactions – here called intergranular strain – can be orders of magnitude larger than intracrystalline strain, which significantly weakens olivine strength. This result, extrapolated along mantle geotherms, suggests that intergranular plasticity could be dominant in most of the upper mantle. Consequently, the strength of olivine-rich aggregates in the upper mantle may be significantly lower than predicted by flow laws based on intracrystalline plasticity models.