Reposted by Camilla Ulleland Hoel
Camilla Ulleland Hoel
@camillahoel.bsky.social
410 followers 325 following 1.6K posts
PhD, academic (Victorian & 20th & 21st c. literature, fans: Dickens, via Sherlock Holmes, to scifi), feminist, bibliophile, geek; regularly political. She/her.
![ENVIRONMENTAL AND FINANCIAL COST
Strubell et al. recently benchmarked model training and development costs in terms of dollars and estimated 퐶푂2 emissions [129].
While the average human is responsible for an estimated 5t 퐶푂2푒
per year,2
the authors trained a Transformer (big) model [136] with
neural architecture search and estimated that the training procedure
emitted 284t of 퐶푂2. Training a single BERT base model (without
hyperparameter tuning) on GPUs was estimated to require as much
energy as a trans-American flight.
While some of this energy comes from renewable sources, or
cloud compute companies’ use of carbon credit-offset sources, the
authors note that the majority of cloud compute providers’ energy is
not sourced from renewable sources and many energy sources in the
world are not carbon neutral. In addition, renewable energy sources
are still costly to the environment,3
and data centers with increasing
computation requirements take away from other potential uses of](https://cdn.bsky.app/img/feed_thumbnail/plain/did:plc:66lbtw2porscqpmair6mir37/bafkreidy7oi2vznvk3xbvoscms4e2pds54pwv6k3aqhde2ezqiy7cy75i4)
![When we perform risk/benefit analyses of language technology,
we must keep in mind how the risks and benefits are distributed,
because they do not accrue to the same people. On the one hand, it
is well documented in the literature on environmental racism that
the negative effects of climate change are reaching and impacting
the world’s most marginalized communities first [1, 27].6
Is it fair or
just to ask, for example, that the residents of the Maldives (likely to
be underwater by 2100 [6]) or the 800,000 people in Sudan affected](https://cdn.bsky.app/img/feed_thumbnail/plain/did:plc:66lbtw2porscqpmair6mir37/bafkreiab7kewjfrvolalvvyndkd4ax2ndpd7grjak5hr6khykjhfkgmpdq)
![“You think we’re getting a little too close to Meta?” [John Georges, co-owner of Georges Media Group, the state’s largest media organization and parent company of the state’s largest newspaper, The Times-Picayune | The New Orleans Advocate], asked. “I’m not afraid of the sun. You know — Icarus? I’ll get as close to the sun as I can.”](https://cdn.bsky.app/img/feed_thumbnail/plain/did:plc:mencpxk4spd3xn3qotwkyyqf/bafkreia33tcihiyejau2ixybgiv7jkvehdllebx47swwbiuevu54p574ry)
