Recent posts

[๋จธ์‹ ๋Ÿฌ๋‹] MLE ๊ธฐ์ˆ  ๋ฉด์ ‘ ๋Œ€๋น„ ์งˆ๋ฌธ - ์ˆ˜ํ•™, ํ†ต๊ณ„

์ˆ˜ํ•™, ํ†ต๊ณ„, ๋จธ์‹ ๋Ÿฌ๋‹, ๋”ฅ๋Ÿฌ๋‹ ๊ธฐ์ˆ  ๋ฉด์ ‘์„ ์œ„ํ•œ ๋ฌธ์ œ์™€ ๋‹ต๋ณ€ ํ•ด๋ณด๊ธฐ. ๋ณธ ํฌ์ŠคํŒ…์€ ๊ฐœ๋…์— ๋Œ€ํ•ด ๊นŠ์ด ์žˆ๊ฒŒ ์ดํ•ดํ•œ๋‹ค๊ธฐ ๋ณด๋‹ค๋Š” ํญ๋„“๊ฒŒ ์•„๋Š” ๊ฒƒ์— ์ค‘์ ์„ ๋‘ .

[๋…ผ๋ฌธ ๋ฆฌ๋ทฐ] Attention Is All You Need[3]: Feed-Forward, Positional Encoding

์ž์—ฐ์–ด ๋ถ„์•ผ์˜ ํ•ต์‹ฌ ๋…ผ๋ฌธ ์ค‘ ํ•˜๋‚˜์ธ Attention Is All You Need์„ ๋ฆฌ๋ทฐํ•œ๋‹ค. ์–ดํ…์…˜ ์•Œ๊ณ ๋ฆฌ์ฆ˜๊ณผ ๋ชจ๋ธ ์•„ํ‚คํƒ์ฒ˜๋ฅผ ๊ทธ๋ฆผ๊ณผ ์ฝ”๋“œ๋ฅผ ํ†ตํ•ด ์ดํ•ดํ•˜๊ณ , ๋ณ‘๋ ฌ์„ฑ ๊ด€์ ์—์„œ ์‚ดํŽด๋ณธ๋‹ค.

[๋…ผ๋ฌธ ๋ฆฌ๋ทฐ] Attention Is All You Need[2]: Attention

์ž์—ฐ์–ด ๋ถ„์•ผ์˜ ํ•ต์‹ฌ ๋…ผ๋ฌธ ์ค‘ ํ•˜๋‚˜์ธ Attention Is All You Need์„ ๋ฆฌ๋ทฐํ•œ๋‹ค. ์–ดํ…์…˜ ์•Œ๊ณ ๋ฆฌ์ฆ˜๊ณผ ๋ชจ๋ธ ์•„ํ‚คํƒ์ฒ˜๋ฅผ ๊ทธ๋ฆผ๊ณผ ์ฝ”๋“œ๋ฅผ ํ†ตํ•ด ์ดํ•ดํ•˜๊ณ , ๋ณ‘๋ ฌ์„ฑ ๊ด€์ ์—์„œ ์‚ดํŽด๋ณธ๋‹ค.