nb_kernel213_x86_64_sse.intel_syntax.s
来自「最著名最快的分子模拟软件」· S 代码 · 共 1,954 行 · 第 1/4 页
S
1,954 行
movaps xmm4, [rsp + nb213_two] mulps xmm3, xmm5 subps xmm4, xmm3 mulps xmm4, xmm5 ;# xmm4=rinvsq movaps xmm3, xmm4 ;# rinvsq mulps xmm4, xmm4 ;# rinv4 mulps xmm4, xmm3 ;# rinv6 movaps xmm5, xmm4 mulps xmm5, xmm5 ;# rinv12 mulps xmm4, [rsp + nb213_c6] mulps xmm5, [rsp + nb213_c12] movaps xmm6, xmm5 subps xmm6, xmm4 ;# Vvdw=vvdw12-vvdw6 mulps xmm4, [rsp + nb213_six] mulps xmm5, [rsp + nb213_twelve] subps xmm5, xmm4 mulps xmm3, xmm5 ;# fscal addps xmm6, [rsp + nb213_Vvdwtot] movaps [rsp + nb213_Vvdwtot], xmm6 mulps xmm13, xmm3 ;# fx mulps xmm14, xmm3 ;# fy mulps xmm15, xmm3 ;# fz ;# save j force temporarily movaps [rsp + nb213_fjx], xmm13 movaps [rsp + nb213_fjy], xmm14 movaps [rsp + nb213_fjz], xmm15 ;# increment i O force addps xmm13, [rsp + nb213_fixO] addps xmm14, [rsp + nb213_fiyO] addps xmm15, [rsp + nb213_fizO] movaps [rsp + nb213_fixO], xmm13 movaps [rsp + nb213_fiyO], xmm14 movaps [rsp + nb213_fizO], xmm15 ;# finished O LJ interaction. ;# do H1, H2, and M interactions in parallel. ;# xmm0-xmm2 still contain j coordinates. movaps xmm3, xmm0 movaps xmm4, xmm1 movaps xmm5, xmm2 movaps xmm6, xmm0 movaps xmm7, xmm1 movaps xmm8, xmm2 subps xmm0, [rsp + nb213_ixH1] subps xmm1, [rsp + nb213_iyH1] subps xmm2, [rsp + nb213_izH1] subps xmm3, [rsp + nb213_ixH2] subps xmm4, [rsp + nb213_iyH2] subps xmm5, [rsp + nb213_izH2] subps xmm6, [rsp + nb213_ixM] subps xmm7, [rsp + nb213_iyM] subps xmm8, [rsp + nb213_izM] movaps [rsp + nb213_dxH1], xmm0 movaps [rsp + nb213_dyH1], xmm1 movaps [rsp + nb213_dzH1], xmm2 mulps xmm0, xmm0 mulps xmm1, xmm1 mulps xmm2, xmm2 movaps [rsp + nb213_dxH2], xmm3 movaps [rsp + nb213_dyH2], xmm4 movaps [rsp + nb213_dzH2], xmm5 mulps xmm3, xmm3 mulps xmm4, xmm4 mulps xmm5, xmm5 movaps [rsp + nb213_dxM], xmm6 movaps [rsp + nb213_dyM], xmm7 movaps [rsp + nb213_dzM], xmm8 mulps xmm6, xmm6 mulps xmm7, xmm7 mulps xmm8, xmm8 addps xmm0, xmm1 addps xmm0, xmm2 addps xmm3, xmm4 addps xmm3, xmm5 addps xmm6, xmm7 addps xmm6, xmm8 ;# start doing invsqrt for j atoms rsqrtps xmm1, xmm0 rsqrtps xmm4, xmm3 rsqrtps xmm7, xmm6 movaps xmm2, xmm1 movaps xmm5, xmm4 movaps xmm8, xmm7 mulps xmm1, xmm1 ;# lu*lu mulps xmm4, xmm4 ;# lu*lu mulps xmm7, xmm7 ;# lu*lu movaps xmm9, [rsp + nb213_three] movaps xmm10, xmm9 movaps xmm11, xmm9 mulps xmm1, xmm0 ;# rsq*lu*lu mulps xmm4, xmm3 ;# rsq*lu*lu mulps xmm7, xmm6 ;# rsq*lu*lu subps xmm9, xmm1 subps xmm10, xmm4 subps xmm11, xmm7 ;# 3-rsq*lu*lu mulps xmm9, xmm2 mulps xmm10, xmm5 mulps xmm11, xmm8 ;# lu*(3-rsq*lu*lu) movaps xmm4, [rsp + nb213_half] mulps xmm9, xmm4 ;# rinvH1 mulps xmm10, xmm4 ;# rinvH2 mulps xmm11, xmm4 ;# rinvM ;# interactions ;# rsq in xmm0,xmm3,xmm6 ;# rinv in xmm9, xmm10, xmm11 movaps xmm1, xmm9 ;# copy of rinv movaps xmm4, xmm10 movaps xmm7, xmm11 movaps xmm2, [rsp + nb213_krf] mulps xmm9, xmm9 ;# rinvsq mulps xmm10, xmm10 mulps xmm11, xmm11 mulps xmm0, xmm2 ;# k*rsq mulps xmm3, xmm2 mulps xmm6, xmm2 movaps xmm2, xmm0 ;# copy of k*rsq movaps xmm5, xmm3 movaps xmm8, xmm6 addps xmm2, xmm1 ;# rinv+krsq addps xmm5, xmm4 addps xmm8, xmm7 movaps xmm14, [rsp + nb213_crf] subps xmm2, xmm14 ;# rinv+krsq-crf subps xmm5, xmm14 subps xmm8, xmm14 movaps xmm12, [rsp + nb213_qqH] movaps xmm13, [rsp + nb213_qqM] mulps xmm2, xmm12 ;# voul=qq*(rinv+ krsq-crf) mulps xmm5, xmm12 ;# voul=qq*(rinv+ krsq-crf) mulps xmm8, xmm13 ;# voul=qq*(rinv+ krsq-crf) addps xmm0, xmm0 ;# 2*krsq addps xmm3, xmm3 addps xmm6, xmm6 subps xmm1, xmm0 ;# rinv-2*krsq subps xmm4, xmm3 subps xmm7, xmm6 mulps xmm1, xmm12 ;# (rinv-2*krsq)*qq mulps xmm4, xmm12 mulps xmm7, xmm13 addps xmm2, [rsp + nb213_vctot] addps xmm5, xmm8 addps xmm2, xmm5 movaps [rsp + nb213_vctot], xmm2 mulps xmm1, xmm9 ;# fscal mulps xmm4, xmm10 mulps xmm7, xmm11 mov rdi, [rbp + nb213_faction] ;# move j forces to local temp variables movlps xmm9, [rdi + rax*4] ;# jxa jya - - movlps xmm10, [rdi + rcx*4] ;# jxc jyc - - movhps xmm9, [rdi + rbx*4] ;# jxa jya jxb jyb movhps xmm10, [rdi + rdx*4] ;# jxc jyc jxd jyd movss xmm11, [rdi + rax*4 + 8] ;# jza - - - movss xmm12, [rdi + rcx*4 + 8] ;# jzc - - - movss xmm6, [rdi + rbx*4 + 8] ;# jzb movss xmm8, [rdi + rdx*4 + 8] ;# jzd movlhps xmm11, xmm6 ;# jza - jzb - movlhps xmm12, xmm8 ;# jzc - jzd - shufps xmm11, xmm12, 136 ;# 10001000 => jza jzb jzc jzd ;# xmm9: jxa jya jxb jyb ;# xmm10: jxc jyc jxd jyd ;# xmm11: jza jzb jzc jzd movaps xmm0, xmm1 movaps xmm2, xmm1 movaps xmm3, xmm4 movaps xmm5, xmm4 movaps xmm6, xmm7 movaps xmm8, xmm7 mulps xmm0, [rsp + nb213_dxH1] mulps xmm1, [rsp + nb213_dyH1] mulps xmm2, [rsp + nb213_dzH1] mulps xmm3, [rsp + nb213_dxH2] mulps xmm4, [rsp + nb213_dyH2] mulps xmm5, [rsp + nb213_dzH2] mulps xmm6, [rsp + nb213_dxM] mulps xmm7, [rsp + nb213_dyM] mulps xmm8, [rsp + nb213_dzM] ;# fetch forces from O interaction movaps xmm13, [rsp + nb213_fjx] movaps xmm14, [rsp + nb213_fjy] addps xmm11, [rsp + nb213_fjz] addps xmm13, xmm0 addps xmm14, xmm1 addps xmm11, xmm2 addps xmm0, [rsp + nb213_fixH1] addps xmm1, [rsp + nb213_fiyH1] addps xmm2, [rsp + nb213_fizH1] addps xmm13, xmm3 addps xmm14, xmm4 addps xmm11, xmm5 addps xmm3, [rsp + nb213_fixH2] addps xmm4, [rsp + nb213_fiyH2] addps xmm5, [rsp + nb213_fizH2] addps xmm13, xmm6 addps xmm14, xmm7 addps xmm11, xmm8 addps xmm6, [rsp + nb213_fixM] addps xmm7, [rsp + nb213_fiyM] addps xmm8, [rsp + nb213_fizM] movaps [rsp + nb213_fixH1], xmm0 movaps [rsp + nb213_fiyH1], xmm1 movaps [rsp + nb213_fizH1], xmm2 movaps [rsp + nb213_fixH2], xmm3 movaps [rsp + nb213_fiyH2], xmm4 movaps [rsp + nb213_fizH2], xmm5 movaps [rsp + nb213_fixM], xmm6 movaps [rsp + nb213_fiyM], xmm7 movaps [rsp + nb213_fizM], xmm8 ;# xmm9 = fjx ;# xmm10 = fjy ;# xmm11 = fjz movaps xmm15, xmm13 unpcklps xmm13, xmm14 unpckhps xmm15, xmm14 addps xmm9, xmm13 addps xmm10, xmm15 movhlps xmm12, xmm11 ;# fjzc fjzd movlps [rdi + rax*4], xmm9 movhps [rdi + rbx*4], xmm9 movlps [rdi + rcx*4], xmm10 movhps [rdi + rdx*4], xmm10 movss [rdi + rax*4 + 8], xmm11 movss [rdi + rcx*4 + 8], xmm12 shufps xmm11, xmm11, 1 shufps xmm12, xmm12, 1 movss [rdi + rbx*4 + 8], xmm11 movss [rdi + rdx*4 + 8], xmm12 ;# should we do one more iteration? sub dword ptr [rsp + nb213_innerk], 4 jl .nb213_odd_inner jmp .nb213_unroll_loop.nb213_odd_inner: add dword ptr [rsp + nb213_innerk], 4 jnz .nb213_odd_loop jmp .nb213_updateouterdata.nb213_odd_loop: mov rdx, [rsp + nb213_innerjjnr] ;# pointer to jjnr[k] mov eax, [rdx] add qword ptr [rsp + nb213_innerjjnr], 4 xorps xmm4, xmm4 ;# clear reg. movss xmm4, [rsp + nb213_iqM] mov rsi, [rbp + nb213_charge] movhps xmm4, [rsp + nb213_iqH] ;# [qM 0 qH qH] shufps xmm4, xmm4, 41 ;# [0 qH qH qM] movss xmm3, [rsi + rax*4] ;# charge in xmm3 shufps xmm3, xmm3, 0 mulps xmm3, xmm4 movaps [rsp + nb213_qqM], xmm3 ;# use dummy qq for storage xorps xmm6, xmm6 mov rsi, [rbp + nb213_type] mov ebx, [rsi + rax*4] mov rsi, [rbp + nb213_vdwparam] shl ebx, 1 add ebx, [rsp + nb213_ntia] movlps xmm6, [rsi + rbx*4] movaps xmm7, xmm6 shufps xmm6, xmm6, 252 ;# 11111100 shufps xmm7, xmm7, 253 ;# 11111101 movaps [rsp + nb213_c6], xmm6 movaps [rsp + nb213_c12], xmm7 mov rsi, [rbp + nb213_pos] lea rax, [rax + rax*2] movss xmm0, [rsp + nb213_ixO] movss xmm1, [rsp + nb213_iyO] movss xmm2, [rsp + nb213_izO] movss xmm3, [rsp + nb213_ixH1] movss xmm4, [rsp + nb213_iyH1] movss xmm5, [rsp + nb213_izH1] unpcklps xmm0, [rsp + nb213_ixH2] ;# ixO ixH2 - - unpcklps xmm1, [rsp + nb213_iyH2] ;# iyO iyH2 - - unpcklps xmm2, [rsp + nb213_izH2] ;# izO izH2 - - unpcklps xmm3, [rsp + nb213_ixM] ;# ixH1 ixM - - unpcklps xmm4, [rsp + nb213_iyM] ;# iyH1 iyM - - unpcklps xmm5, [rsp + nb213_izM] ;# izH1 izM - - unpcklps xmm0, xmm3 ;# ixO ixH1 ixH2 ixM unpcklps xmm1, xmm4 ;# same for y unpcklps xmm2, xmm5 ;# same for z ;# move j coords to xmm0-xmm2 movss xmm3, [rsi + rax*4] movss xmm4, [rsi + rax*4 + 4] movss xmm5, [rsi + rax*4 + 8] shufps xmm3, xmm3, 0 shufps xmm4, xmm4, 0 shufps xmm5, xmm5, 0 subps xmm3, xmm0 subps xmm4, xmm1 subps xmm5, xmm2 ;# use O distances for storage movaps [rsp + nb213_dxO], xmm3 movaps [rsp + nb213_dyO], xmm4 movaps [rsp + nb213_dzO], xmm5 mulps xmm3, xmm3 mulps xmm4, xmm4 mulps xmm5, xmm5 addps xmm4, xmm3 addps xmm4, xmm5 ;# rsq in xmm4 movaps xmm0, xmm4 mulps xmm0, [rsp + nb213_krf] movaps [rsp + nb213_krsqM], xmm0 rsqrtps xmm5, xmm4 ;# lookup seed in xmm5 movaps xmm2, xmm5 mulps xmm5, xmm5 movaps xmm1, [rsp + nb213_three] mulps xmm5, xmm4 ;# rsq*lu*lu movaps xmm0, [rsp + nb213_half] subps xmm1, xmm5 ;# 30-rsq*lu*lu mulps xmm1, xmm2 mulps xmm0, xmm1 ;# xmm0=rinv movaps xmm4, xmm0 movaps xmm1, xmm0 movaps xmm5, xmm0 mulps xmm4, xmm4 ;# xmm1=rinv, xmm4=rinvsq movaps xmm3, [rsp + nb213_krsqM] addps xmm5, xmm3 ;# xmm0=rinv+ krsq subps xmm5, [rsp + nb213_crf] ;# xmm0=rinv+ krsq-crf mulps xmm3, [rsp + nb213_two] subps xmm1, xmm3 ;# xmm1=rinv-2*krsq movaps xmm7, xmm5 mulps xmm7, [rsp + nb213_qqM] ;# xmm0=vcoul mulps xmm1, [rsp + nb213_qqM] ;# xmm1=coul part of fs movaps xmm6, xmm1 addps xmm7, [rsp + nb213_vctot] movaps [rsp + nb213_vctot], xmm7 movaps xmm1, xmm0 mulps xmm1, xmm1 movaps xmm2, xmm1 mulss xmm1, xmm1 mulss xmm1, xmm2 ;# xmm1=rinvsix xorps xmm4, xmm4 movss xmm4, xmm1 mulss xmm4, xmm4 ;# xmm4=rinvtwelve mulss xmm1, [rsp + nb213_c6] mulss xmm4, [rsp + nb213_c12] movaps xmm3, xmm4 subss xmm3, xmm1 ;# xmm3=Vvdw12-Vvdw6 mulss xmm1, [rsp + nb213_six] mulss xmm4, [rsp + nb213_twelve] subss xmm4, xmm1 addss xmm3, [rsp + nb213_Vvdwtot] movss [rsp + nb213_Vvdwtot], xmm3 addps xmm4, xmm6 mulps xmm4, xmm0 mulps xmm4, xmm0 ;# fscal movaps xmm0, [rsp + nb213_dxO] movaps xmm1, [rsp + nb213_dyO] movaps xmm2, [rsp + nb213_dzO] mulps xmm0, xmm4 mulps xmm1, xmm4 mulps xmm2, xmm4 ;# xmm0-xmm2 now contains tx-tz (partial force) movss xmm3, [rsp + nb213_fixO] movss xmm4, [rsp + nb213_fiyO] movss xmm5, [rsp + nb213_fizO] addss xmm3, xmm0 addss xmm4, xmm1 addss xmm5, xmm2 movss [rsp + nb213_fixO], xmm3 movss [rsp + nb213_fiyO], xmm4 movss [rsp + nb213_fizO], xmm5 ;# updated the O force now do the H's movaps xmm3, xmm0 movaps xmm4, xmm1 movaps xmm5, xmm2 shufps xmm3, xmm3, 0x39 ;# shift right shufps xmm4, xmm4, 0x39 shufps xmm5, xmm5, 0x39 addss xmm3, [rsp + nb213_fixH1] addss xmm4, [rsp + nb213_fiyH1] addss xmm5, [rsp + nb213_fizH1] movss [rsp + nb213_fixH1], xmm3 movss [rsp + nb213_fiyH1], xmm4 movss [rsp + nb213_fizH1], xmm5 ;# updated the H1 force shufps xmm3, xmm3, 0x39 shufps xmm4, xmm4, 0x39 shufps xmm5, xmm5, 0x39 addss xmm3, [rsp + nb213_fixH2] addss xmm4, [rsp + nb213_fiyH2] addss xmm5, [rsp + nb213_fizH2] movss [rsp + nb213_fixH2], xmm3 movss [rsp + nb213_fiyH2], xmm4 movss [rsp + nb213_fizH2], xmm5 ;# updated the H2 force mov rdi, [rbp + nb213_faction] shufps xmm3, xmm3, 0x39 shufps xmm4, xmm4, 0x39 shufps xmm5, xmm5, 0x39 addss xmm3, [rsp + nb213_fixM] addss xmm4, [rsp + nb213_fiyM] addss xmm5, [rsp + nb213_fizM] movss [rsp + nb213_fixM], xmm3 movss [rsp + nb213_fiyM], xmm4 movss [rsp + nb213_fizM], xmm5 ;# updated the M force ;# the fj's - move in from mem start by acc. tx/ty/tz in xmm0, xmm1 movlps xmm6, [rdi + rax*4] movss xmm7, [rdi + rax*4 + 8] movhlps xmm3, xmm0 movhlps xmm4, xmm1 movhlps xmm5, xmm2 addps xmm3, xmm0 addps xmm4, xmm1 addps xmm5, xmm2 movaps xmm0, xmm3 movaps xmm1, xmm4 movaps xmm2, xmm5 shufps xmm3, xmm3, 0x39 ;# shift right shufps xmm4, xmm4, 0x39 shufps xmm5, xmm5, 0x39 addss xmm0, xmm3 addss xmm1, xmm4 addss xmm2, xmm5 unpcklps xmm0, xmm1 ;# x,y sum in xmm0, z sum in xmm2 addps xmm6, xmm0 addss xmm7, xmm2 movlps [rdi + rax*4], xmm6 movss [rdi + rax*4 + 8], xmm7 dec dword ptr [rsp + nb213_innerk] jz .nb213_updateouterdata jmp .nb213_odd_loop.nb213_updateouterdata: mov ecx, [rsp + nb213_ii3] mov rdi, [rbp + nb213_faction] mov rsi, [rbp + nb213_fshift] mov edx, [rsp + nb213_is3] ;# accumulate Oi forces in xmm0, xmm1, xmm2 movaps xmm0, [rsp + nb213_fixO] movaps xmm1, [rsp + nb213_fiyO] movaps xmm2, [rsp + nb213_fizO]
⌨️ 快捷键说明
复制代码Ctrl + C
搜索代码Ctrl + F
全屏模式F11
增大字号Ctrl + =
减小字号Ctrl + -
显示快捷键?