 Infidelity may have been a particularly sore point for him; Grey's father died before he was born and there were rumours that Lieutenant-Colonel George Grey was not actually his parent.Grey's meteoric rise through the colonial service contributed to the rumours that his real father was in fact Prince Edward, Duke of Kent and Strathearn (making him Queen Victoria's half-sibling) or one of the other Royal Dukes, explaining the favouritism shown to him by Victoria.Untrue as this was, Grey was aware of the rumours and thus probably hypersensitive to any behaviour by Eliza that might be misconstrued as infidelity.