A fusion scheme for multispectral image and panchromatic image is proposed based on original EMD （empirical mode decomposition）algorithm.To use multivariate EMD,firstly it look the image as multivariate,and project them into corresponding directional vectors,therefore it gets intrinsic mode functions and residual.At last,experiment is made and results show that this algorithm is not only preserve spectral information but also get a image containing more space details.